Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

EMS Compression Error #29

Open
vahid-dan opened this issue Jul 10, 2017 · 0 comments
Open

EMS Compression Error #29

vahid-dan opened this issue Jul 10, 2017 · 0 comments
Labels

Comments

@vahid-dan
Copy link
Contributor

vahid-dan commented Jul 10, 2017

While the jobs are done, EMS happened to be unable to finalize the results and the experiment completion got stuck in 98%. A sudo systemctl restart ems.service recovered the results; But, the output compressed files seams corrupted.

On the Submit Node:

● ems.service - Experiment management service to support GWS
   Loaded: loaded (/etc/systemd/system/ems.service; enabled; vendor preset: enabled)
   Active: active (running) since Tue 2017-07-04 12:09:39 EDT; 6 days ago
 Main PID: 281976 (python)
    Tasks: 8
   Memory: 33.2G
      CPU: 6d 8h 32min 30.252s
   CGroup: /system.slice/ems.service
           ├─281976 /usr/bin/python ems.py
           ├─488301 perl /usr/bin/parallel -P 2 tar jxf ::: Results62.tar.bz2 Results178.tar.bz2 Results181.tar.bz2 Results205.tar.bz2 Results7.tar.bz2 Results20.tar.bz2 Results172.tar.bz2 Results50.tar.b
           ├─488603 tar jxf Results77.tar.bz2
           ├─488604 bzip2 -d
           ├─488607 tar jxf Results98.tar.bz2
           └─488608 bzip2 -d

Jul 10 12:53:50 graple-Submit python[281976]:         perhaps it is corrupted?  *Possible* reason follows.
Jul 10 12:53:50 graple-Submit python[281976]: bzip2: Inappropriate ioctl for device
Jul 10 12:53:50 graple-Submit python[281976]:         Input file = (stdin), output file = (stdout)
Jul 10 12:53:50 graple-Submit python[281976]: It is possible that the compressed file(s) have become corrupted.
Jul 10 12:53:50 graple-Submit python[281976]: You can use the -tvv option to test integrity of such files.
Jul 10 12:53:50 graple-Submit python[281976]: You can use the `bzip2recover' program to attempt to recover
Jul 10 12:53:50 graple-Submit python[281976]: data from undamaged sections of corrupted files.
Jul 10 12:53:50 graple-Submit python[281976]: tar: Unexpected EOF in archive
Jul 10 12:53:50 graple-Submit python[281976]: tar: Unexpected EOF in archive
Jul 10 12:53:50 graple-Submit python[281976]: tar: Error is not recoverable: exiting now

On RStudio Console after Attempting to Download the Results:

gzip: results.tar.gz: unexpected end of file
gzip: results.tar.gz: uncompress failed
Sims/Sim78_1/Results/output.nc: Truncated tar archive
tar: Error exit delayed from previous errors.
Warning message:
In untar("results.tar.gz") :
  ‘/usr/bin/gzip -dc 'results.tar.gz' | /usr/bin/tar -xf '-'’ returned error code 1
@vahid-dan vahid-dan added the bug label Jul 10, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant