Multiple inserts

Question

Multiple inserts

GunslerRage Sep '18

Created Sep '18	Last Reply Oct '18	Replies 3	Views 348	Votes 1

GunslerRage 40.6k

Sep '18

Hello.

I am trying to make a PHP script, that allows the user to upload an XML file from their wordpress file and upload there pages, posts & comments to my site - NOT a wordpress site.

I have a custom database, so i have to rewrite the dataset to my database.

However - What if the user have more than 1000 posts, how to I insert 1000 posts without getting memory limit?

I have tried this, wich I got from a older post that I made, but it's not working

    $phql = "INSERT INTO \Blogmoda\Models\Posts\Posts (blog_id, title, thumbnail, excerpt, content) " . "VALUES (:blog_id:, :title:, :thumbnail:, :excerpt:, :content:)";
        $query = $this->modelsManager->createQuery($phql);
        $query->execute([ "blog_id" => 48, "title" => 'loooololol', "thumbnail" => 2, "excerpt" => "jsadjsa", "content" => "<p>lol</p>"]);
        foreach($posts as $post){

            $query->execute([ "blog_id" => 48, "title" => $post['title'], "thumbnail" => 2, "excerpt" => "jsadjsa", "content" => "<p>lol</p>"]);

        }

But it is not inserting, and no error message..

1

Nikolay Mihaylov · Answer 1 · 2018-09-24T23:29:25-07:00

Just make the script as you would, but add "limit" parameter, for example 100 records. After that set this script into a crontab and you are done :)

You can have a flag is_processed = 0 / 1 or use temporary table.

GunslerRage · Answer 2 · 2018-09-25T00:41:16-07:00

Thank you for your answer

Can you provide me with a little more details, links, maybe some code?

Lajos Bencz · Answer 3 · 2018-09-28T01:37:50-07:00

you could also parse the xml file in batches, then theres no need for a status flag. the class you need to extend is \XmlStreamer

Karolis Mačiulskis · Answer 4 · 2018-10-23T04:11:49-07:00

Karolis Mačiulskis
26.3k

Oct '18

I suggest you to use producer - worker - consumer, to scale and isolate processes.