Problem with cURL, redirection and frame.

[blizzardofozz]

Hello guys,

 

I have this problem – I want to receive results from external database search using cURL. The form action of the external page leads to .cgi file using POST method. Then redirect happens to a page on other server (HTTP/1.1 302 Moved Temporarily), which I can follow (CURLOPT_FOLLOWLOCATION) but the problem is that the new location page is created using frameset and I cannot follow frame src to receive desired data, which is displayed into one of the frames.

 

If I use GET method:

$cUrl = curl_init();

curl_setopt($cUrl, CURLOPT_URL,’http://address.com?search=whatever’);

curl_setopt($cUrl, CURLOPT_RETURNTRANSFER, 1);

curl_setopt($cUrl, CURLOPT_FOLLOWLOCATION, 1);

$pageContent = trim(curl_exec($cUrl));

curl_close($cUrl);

echo $pageContent;

then I receive desired page but with no info in it since no POST to form action script was sent.

 

I’m stuck on this for couple of days and I really hope someone to help me on this.

 

[requinix]

Not terribly automation-friendly. Is there an API you can use instead? Are you page scraping something you shouldn't?

 

You could always do a regular expression on the frame source and a second cURL request. Depends what the HTML looks like...

[blizzardofozz]

I guess there is no problem to use this form since it’s free to use and doesn’t requires registration. Just want to use it on other site and I will contribute the source. There is nothing hidden there.

 

“You could always do a regular expression on the frame source and a second cURL request.”

You mean to cURL the string $pageContent? How to do that?

 

[requinix]

Wait, so, is this address.com yours as well?

[blizzardofozz]

It is not mine.

It is not the real www.address.com, let say it’s example.com