Resume the harvesting processing when the oai pmh server is not responding

[Aazhar]

Use the last diagnosis like error 500 on the oai-pmh server.

[lfoppiano]

I'm having some problems while downloading, the process terminate without any error message.

e.g. this was the message I've got and the java process was not running anymore.

04 Jan 2017 10:40.02 [INFO ] OAIPMHHarvester           - 	 Sending: http://api.archives-ouvertes.fr/oai/hal/?verb=ListRecords&metadataPrefix=xml-tei&from=2002-03-09&until=2002-03-09

On a side note, while investigating I've discovered that here you assume that an exception means having no binary file. I think it's an assumption a bit too strong because any error that is not managed in the Utilities.getconnection()'s method will result in the wrong status.

[lfoppiano]

Here another example from today (15:10 - Sat 7Jan):

[lfoppian@traces3 harvest]$ tail harvest.log
07 Jan 2017 04:00.01 [INFO ] OAIPMHHarvester           - 		 Processing TEI for halshs-00412216
07 Jan 2017 04:00.01 [INFO ] OAIPMHHarvester           - 				 Storing TEI halshs-00412216
07 Jan 2017 04:00.01 [INFO ] OAIPMHHarvester           - 				 PDF not found !
07 Jan 2017 04:00.01 [INFO ] OAIPMHHarvester           - 		 Processing TEI for halshs-00412217
07 Jan 2017 04:00.01 [INFO ] OAIPMHHarvester           - 				 Storing TEI halshs-00412217
07 Jan 2017 04:00.01 [INFO ] OAIPMHHarvester           - 				 PDF not found !
07 Jan 2017 04:00.01 [INFO ] OAIPMHHarvester           - 		 Processing TEI for halshs-00412218
07 Jan 2017 04:00.01 [INFO ] OAIPMHHarvester           - 				 Storing TEI halshs-00412218
07 Jan 2017 04:00.01 [INFO ] OAIPMHHarvester           - 				 PDF not found !
07 Jan 2017 04:00.01 [INFO ] OAIPMHHarvester           - 	 Sending: http://api.archives-ouvertes.fr/oai/hal/?verb=ListRecords&resumptionToken=
[lfoppian@traces3 harvest]$ ps afx  | grep harvest
33226 pts/0    S+     0:00              \_ grep --color=auto harvest
[lfoppian@traces3 harvest]$