- Silent
- Posts : 2
Join date : 2015-07-02
Correct way to wait until the page is ready
Thu Jul 02, 2015 4:44 am
Hello!
I'm using Selenium to write a basic scraper that's looking for links on every page.
The reason I'm using Selenium is that some sites are dynamically generated.
My problem is that I can't determine when a page is done loading before going over the DOM - as there's no specific element that I'm looking for. I need the whole page.
What is the correct way to do this?
If you are going to provide coding samples, it would be best if you used Python (though I can understand other languages as well).
Thanks
I'm using Selenium to write a basic scraper that's looking for links on every page.
The reason I'm using Selenium is that some sites are dynamically generated.
My problem is that I can't determine when a page is done loading before going over the DOM - as there's no specific element that I'm looking for. I need the whole page.
What is the correct way to do this?
If you are going to provide coding samples, it would be best if you used Python (though I can understand other languages as well).
Thanks
- seluserqwb1Active particpant
- Posts : 20
Join date : 2015-06-29
Re: Correct way to wait until the page is ready
Mon Jul 06, 2015 8:04 pm
Please post your question in - official WebDriver Forum
- AgoBalanAmateur
- Posts : 36
Join date : 2015-02-23
Re: Correct way to wait until the page is ready
Tue Jul 07, 2015 8:08 pm
driver gives control to user once the entire page is loaded,so in this case no need to worry about page loading at all..
In few cases,page refresh might happen by AJAX, at that time wait for element which appears in UI as a result of the AJAX query..
If not satisfied by the reply,, kinldy add more details to your question,,in which scenario u got struck..
In few cases,page refresh might happen by AJAX, at that time wait for element which appears in UI as a result of the AJAX query..
If not satisfied by the reply,, kinldy add more details to your question,,in which scenario u got struck..
- seluserqwb1Active particpant
- Posts : 20
Join date : 2015-06-29
Re: Correct way to wait until the page is ready
Wed Jul 08, 2015 3:45 pm
Please post your question in official webdriver forum -
www.seleniumtests.com/p/selenium-2-forum.html
www.seleniumtests.com/p/selenium-2-forum.html
Re: Correct way to wait until the page is ready
Thu Jul 09, 2015 1:16 pm
I'm using Selenium to write a basic scraper that's looking for links on every page.
The reason I'm using Selenium is that some sites are dynamically generated.
The reason I'm using Selenium is that some sites are dynamically generated.
- seluserqwb1Active particpant
- Posts : 20
Join date : 2015-06-29
Re: Correct way to wait until the page is ready
Tue Jul 14, 2015 6:00 pm
Please post your question in official webdriver forum -
www.seleniumtests.com/p/selenium-2-forum.html
www.seleniumtests.com/p/selenium-2-forum.html
- AgoBalanAmateur
- Posts : 36
Join date : 2015-02-23
Re: Correct way to wait until the page is ready
Tue Jul 14, 2015 6:11 pm
seluserqwb1 who the hell are you man spamming all threads. get last..
Permissions in this forum:
You cannot reply to topics in this forum