Stop the violin and restore its work
Hello. The next challenge is that when the pictures are downloaded and about a few thousand, 7000-8000, the server will not be able to process the whole case, which is logical.
How can we stop the violin, for example after 100 downloads of the pictures, and then re-establish it at the time of the stop?
My assumption is that you can put in a temporary file a full set of key pictures, then for'em to run, and when he got to 100, reboot the page, but already in the GET, hand over where we stopped and run from that place. You know, we ran through the first 100 items, then we passed the script.php?id=100, and we're running to 200, and we're running to the end until it's over.
The question is, how good are my assumptions, or can you think of something easier?
Loading someone's earring to their base
The best way to download the data from the supplier server to its server is a console crypt that has no time out, unlike the web server. Starting such a violin from the consoles will make it possible to process all the records.
The second option is to record in the session the number of the last processed record from the supplier server and, at each subsequent launch, continue to be processed after that recording.