Reply To: Only importing 100 entries…

07/13/2018 at 12:47 pm #467457
Steven Zahm
Keymaster

@ Matthew

Ok, I am to get 40 — 60 rows of the CSV file to import by deleting all the columns which are not to be imported. This translates into less processing time.

Now, the issue is the server is responding to with:

<title>504 Gateway Timeout</title>
</head><body>
<h1>Gateway Timeout</h1>
<p>The gateway did not receive a timely response
from the upstream server or application.</p>
<p>Additionally, a 504 Gateway Timeout
error was encountered while trying to use an ErrorDocument to handle the request.</p>

PHP seems to be configured with a max execution time of 240 seconds which would be plenty as the average batch should only take about 30 seconds.

But, it seems the host might be “hard” limiting the PHP process to only about 20 seconds. This is just a little too limiting.

With this in mind, I altered the import process so it only imports 10 rows per batch instead on the default 20.

I’ve started the import which should be complete in about 20 minutes assuming it doesn’t timeout.

I’ll let you know the results very soon.

I’ve attached the updated CSV file.

Attachments:
You must be logged in to view attached files.