Topic: how to fopen a site that requires a username and password ?

[bidntrade]

I have a site that has a csv feed updated everyday ...

I have a script that i use to parse the csv and update my database
each day . the problem is i must manually download the csv
and upload to my ftp server for the script to work ...

now im using :

Code: (text) [Select]

$handle = fopen("DataFeed.csv", "r");
i would like to be able to pull it directly like this

Code: (text) [Select]

$handle = fopen("http://www.sitenamehere.com/Reseller/Feeds/GetDataFeed.asp?type=csv", "r");
that way it could be run automated each night ....

the problem is the site requires me to login before i have access to the file download...

the site owner said something about : 

so what you're basically looking for is

How to implement impersonation in an ASP.net application,

not sure what they was talking about ...

are there a way around this ?

[JJ2K]

What happens if you do something like:

Code: [Select]

$file = 'http://www.sitenamehere.com/Reseller/Feeds/GetDataFeed.asp?type=csv' ;

$data = file_get_contents($file) or die('Could not read file!');
echo $data;
Is it getting the file

If not don't you have a direct link to the .csv file so you can point it to that

[bidntrade]

problem is :

the site owner requires a login to there site to access.

no direct link cause its generated dynamically price updates each night ....

[PFMaBiSmAd]

If you supplied a little more information it would help -

Is the login form an actual form on a web page or is it a HTTP Basic Authentication dialog box (looks like a pop up/alert window)?

Also, if the file was available through FTP, you could just supply the username/password as part of the URL.

In general, you would need to use CURL in order to log into a web page.

[bidntrade]

the login is from a Form on the webpage

the form has 2 input boxes :
username
password

the same supplier has a xml url thats not passworded .. but i dont know how to parse xml files ....

but the xml file is 14megs and the csv is 2 megs

[mattal999]

Well here's my analogy of the solution:

1) Use cURL to call the login page (Not the form, the url the form POSTs to) specifying 2 post paremeters (two field names on form - username and password likely).
2) This should allow you to access the .csv file through file_get_contents, fopen or cURL. Your choice.

As for the code, I have no idea

Read up on cURL.