Seg Fault when an incomplete record is in the database

[bschwal]

I imported a csv file into a SOS container without realizing the last line of the csv was truncated such that only a couple of the fields existed. When I try to view the data in the file that matches this record (using sos_cmd or python API) the query seg faults. I would not have expected this record to be imported into the database in the first place.

[tom95858]

@bschwal could you please send me the git commit-id at the top of your source tree?

[bschwal]

My sha's
ovis: 66c8c5528ec595b40ea42fea74bd562c43db1e47
sos: 3177b4c

[tom95858]

Thanks, do you have a core dump?

[bschwal]

Just a small dump into /var/log/messages:

systemd-coredump[1904265]: Process 1904134 (python3) of user 0 dumped core.#12#012Stack trace of thread 1904134:#12#0 0x00007f73b15dd210 sos_value_cmp (libsos.so.0)#12#1 0x00007f73b15dac19 eq_fn (libsos.so.0)#12#2 0x00007f73b15dba04 sos_filter_eval (libsos.so.0)#12#3 0x00007f73b15dbb15 next_match (libsos.so.0)#12#4 0x00007f73b1895231 __pyx_pf_6python_3Sos_12QueryInputer_12input (Sos.so)#12#5 0x00007f73b1894a03 __pyx_pw_6python_3Sos_12QueryInputer_13input (Sos.so)#12#6 0x00007f73b3251f04 PyCFunction_Call (libpython3.6m.so.1.0)#12#7 0x00007f73b18f6458 __Pyx_PyObject_Call (Sos.so)#12#8 0x00007f73b18b2ef7 __pyx_pf_6python_3Sos_5Query_12query (Sos.so)#12#9 0x00007f73b18b29a0 __pyx_pw_6python_3Sos_5Query_13query (Sos.so)#12#10 0x00007f73b3259301 call_function (libpython3.6m.so.1.0)#12#11 0x00007f73b325a904 _PyEval_EvalFrameDefault (libpython3.6m.so.1.0)#12#12 0x00007f73b31b5754 _PyEval_EvalCodeWithName (libpython3.6m.so.1.0)#12#13 0x00007f73b3235de0 fast_function (libpython3.6m.so.1.0)#12#14 0x00007f73b3259087 call_function (libpython3.6m.so.1.0)#12#15 0x00007f73b3259cc8 _PyEval_EvalFrameDefault (libpython3.6m.so.1.0)#12#16 0x00007f73b31b5754 _PyEval_EvalCodeWithName (libpython3.6m.so.1.0)#12#17 0x00007f73b3235de0 fast_function (libpython3.6m.so.1.0)#12#18 0x00007f73b3259087 call_function (libpython3.6m.so.1.0)#12#19 0x00007f73b325a904 _PyEval_EvalFrameDefault (libpython3.6m.so.1.0)#12#20 0x00007f73b31b5754 _PyEval_EvalCodeWithName (libpython3.6m.so.1.0)#12#21 0x00007f73b31b6af3 PyEval_EvalCode (libpython3.6m.so.1.0)#12#22 0x00007f73b32c56d2 run_mod (libpython3.6m.so.1.0)#12#23 0x00007f73b319637d PyRun_FileExFlags (libpython3.6m.so.1.0)#12#24 0x00007f73b319b478 PyRun_SimpleFileExFlags (libpython3.6m.so.1.0)#12#25 0x00007f73b319bdc7 Py_Main.cold.3363 (libpython3.6m.so.1.0)#12#26 0x00005647302aeb96 main (platform-python3.6)#12#27 0x00007f73b23727b3 __libc_start_main (libc.so.6)#12#28 0x00005647302aed1e _start (platform-python3.6)#12#012Stack trace of thread 1904200:#12#0 0x00007f73b2eaa2fc pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0)#12#1 0x00007f71876960cb blas_thread_server (libopenblasp-r0-085ca80a.3.9.so)#12#2 0x00007f73b2ea414a start_thread (libpthread.so.0)#12#3 0x00007f73b244bf23 __clone (libc.so.6)#12#012Stack trace of thread 1904206:#12#0 0x00007f73b2eaa2fc pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0)#12#1 0x00007f71876960cb blas_thread_server (libopenblasp-r0-085ca80a.3.9.so)#12#2 0x00007f73b2ea414a start_thread (libpthread.so.0)#12#3 0x00007f73b244bf23 __clone (libc.so.6)#12#012Stack trace of thread 1904207:#12#0 0x00007f73b2eaa2fc pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0)#12#1 0x00007f71876960cb blas_thread_server (libopenblasp-r0-085ca80a.3.9.so)#12#2 0x00007f73b2ea414a start_thread (libpthread.so.0)#12#3 0x00007f73b244bf23 __clone (libc.so.6)#12#012Stack trace of thread 1904135:#12#0 0x00007f73b2417fc8 __nanosleep (libc.so.6)#12#1 0x00007f73b2417ece sleep (libc.so.6)#12#2 0x00007f73b13baf45 gc_thread_fn (libods.so.0)#12#3 0x00007f73b2ea414a start_thread (libpthread.so.0)#12#4 0x00007f73b244bf23 __clone (libc.so.6)#12#012Stack trace of thread 1904204:#12#0 0x00007f73b2eaa2fc pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0)#12#1 0x00007f71876960cb blas_thread_server (libopenblasp-r0-085ca80a.3.9.so)#12#2 0x00007f73b2ea414a start_thread (libpthread.so.0)#12#3 0x00007f73b244bf23 __clone (libc.so.6)#12#012Stack trace of thread 1904203:#12#0 0x00007f73b2eaa2fc pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0)#12#1 0x00007f71876960cb blas_thread_server (libopenblasp-r0-085ca80a.3.9.so)#12#2 0x00007f73b2ea414a start_thread (libpthread.so.0)#12#3 0x00007f73b244bf23 __clone (libc.so.6)#12#012Stack trace of thread 1904202:#12#0 0x00007f73b2eaa2fc pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0)#12#1 0x00007f71876960cb blas_thread_server (libopenblasp-r0-085ca80a.3.9.so)#12#2 0x00007f73b2ea414a start_thread (libpthread.so.0)#12#3 0x00007f73b244bf23 __clone (libc.so.6)#12#012Stack trace of thread 1904201:#12#0 0x00007f73b2eaa2fc pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0)#12#1 0x00007f71876960cb blas_thread_server (libopenblasp-r0-085ca80a.3.9.so)#12#2 0x00007f73b2ea414a start_thread (libpthread.so.0)#12#3 0x00007f73b244bf23 __clone (libc.so.6)#12#012Stack trace of thread 1904222:#12#0 0x00007f73b2eaa2fc pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0)#12#1 0x00007f71876960cb blas_thread_server (libopenblasp-r0-085ca80a.3.9.so)#12#2 0x00007f73b2ea414a start_thread (libpthread.so.0)#12#3 0x00007f73b244bf23 __clone (libc.so.6)#12#012Stack trace of thread 1904205:#12#0 0x00007f73b2eaa2fc pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0)#12#1 0x00007f71876960cb blas_thread_server (libopenblasp-r0-085ca80a.3.9.so)#12#2 0x00007f73b2ea414a start_thread (libpthread.so.0)#12#3 0x00007f73b244bf23 __clone (libc.so.6)#12#012Stack trace of thread 1904224:#12#0 0x00007f73b2eaa2fc pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0)#12#1 0x00007f71876960cb blas_thread_server (libopenblasp-r0-085ca80a.3.9.so)#12#2 0x00007f73b2ea414a start_thread (libpthread.so.0)#12#3 0x00007f73b244bf23 __clone (libc.so.6)#12#012Stack trace of thread 1904225:#12#0 0x00007f73b2eaa2fc pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0)#12#1 0x00007f71876960cb blas_thread_server (libopenblasp-r0-085ca80a.3.9.so)#12#2 0x00007f73b2ea414a start_thread (libpthread.so.0)#12#3 0x00007f73b244bf23 __clone (libc.so.6)#12#012Stack trace of thread 1904223:#12#0 0x00007f73b2eaa2fc pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0)#12#1 0x00007f71876960cb blas_thread_server (libopenblasp-r0-085ca80a.3.9.so)#12#2 0x00007f73b2ea414a start_thread (libpthread.so.0)#12#3 0x00007f73b244bf23 __clone (libc.so.6)#12#012Stack trace of thread 1904209:#12#0 0x00007f73b2eaa2fc pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0)#12#1 0x00007f71876960cb blas_thread_server (libopenblasp-r0-085ca80a.3.9.so)#12#2 0x00007f73b2ea414a start_thread (libpthread.so.0)#12#3 0x00007f73b244bf23 __clone (libc.so.6)#12#012Stack trace of thread 1904210:#12#0 0x00007f73b2eaa2fc pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0)#12#1 0x00007f71876960cb blas_thread_server (libopenblasp-r0-085ca80a.3.9.so)#12#2 0x00007f73b2ea414a start_thread (libpthread.so.0)#12#3 0x00007f73b244bf23 __clone (libc.so.6)#12#012Stack trace of thread 1904226:#12#0 0x00007f73b2eaa2fc pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0)#12#1 0x00007f71876960cb blas_thread_server (libopenblasp-r0-085ca80a.3.9.so)#12#2 0x00007f73b2ea414a start_thread (libpthread.so.0)#12#3 0x00007f73b244bf23 __clone (libc.so.6)#12#012Stack trace of thread 1904208:#12#0 0x00007f73b2eaa2fc pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0)#12#1 0x00007f71876960cb blas_thread_server (libopenblasp-r0-085ca80a.3.9.so)#12#2 0x00007f73b2ea414a start_thread (libpthread.so.0)#12#3 0x00007f73b244bf23 __clone (libc.so.6)#12#012Stack trace of thread 1904212:#12#0 0x00007f73b2eaa2fc pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0)#12#1 0x00007f71876960cb blas_thread_server (libopenblasp-r0-085ca80a.3.9.so)#12#2 0x00007f73b2ea414a start_thread (libpthread.so.0)#12#3 0x00007f73b244bf23 __clone (libc.so.6)#12#012Stack trace of thread 1904213:#12#0 0x00007f73b2eaa2fc pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0)#12#1 0x00007f71876960cb blas_thread_server (libopenblasp-r0-085ca80a.3.9.so)#12#2 0x00007f73b2ea414a start_thread (libpthread.so.0)#12#3 0x00007f73b244bf23 __clone (libc.so.6)#12#012Stack trace of thread 1904211:#12#0 0x00007f73b2eaa2fc pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0)#12#1 0x00007f71876960cb blas_thread_server (libopenblasp-r0-085ca80a.3.9.so)#12#2 0x00007f73b2ea414a start_thread (libpthread.so.0)#12#3 0x00007f73b244bf23 __clone (libc.so.6)#12#012Stack trace of thread 1904215:#12#0 0x00007f73b2eaa2fc pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0)#12#1 0x00007f71876960cb blas_thread_server (libopenblasp-r0-085ca80a.3.9.so)#12#2 0x00007f73b2ea414a start_thread

[bschwal]

I can send in email how to replicate if you wish, I left the "bad" container in place.

[tom95858]

Hi Ben, Yes, please send the instructions to reproduce. Thanks, Tom

…

On Fri, May 14, 2021 at 2:03 PM bschwal ***@***.***> wrote: I can send in email how to replicate if you wish, I left the "bad" container in place. — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#44 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ABVTPXHYEQJCFVV2MI3TWO3TNV6ZPANCNFSM4443RQKQ> .

-- Thomas Tucker, President, Open Grid Computing, Inc.