Handling HTTPS protocol via LWP::UserAgent

Hi,

use LWP::UserAgent;
my $ua = new LWP::UserAgent;
my $req = new HTTP::Request('GET', 'https://test.com');
my $res = $ua->request($req);
print $res->content()."\n";
print $res->code."\n";

The above program works when I have protocol as http, it won't work when the protocol is https.
The problem is, I think in my system "Crypt: Smiley Frustrated

SLeay" is not installed which inturn uses openssl.

My question how to install Crypt: Smiley Frustrated

SLeay in windows xp professional. I tried copying Crypt: Smiley Frustrated

SLeay.pm under lib folder, its not picking.

At the same time I searched a google and forum tried some of the inputs, no success.

Any suggestion to install above module in win xp pro will be helpful.

Or else any suggestion on handling https protocol will be appreciated.

Find more posts tagged with

Comments

Migrateduser

What errors are you getting, specifically?

CPAN's documentation on LWP::UserAgent suggests that HTTPS is possible:

[indent]

$ua->protocols_allowed( \@protocols ): This reads (or sets) this user agent's list of protocols that the request methods will exclusively allow. The protocol names are case insensitive.

For example: $ua->protocols_allowed( [ 'http', 'https'] ); means that this user agent will allow only those protocols, and attempts to use this user agent to access URLs with any other schemes (like "ftp://...") will result in a 500 error.

To delete the list, call: $ua->protocols_allowed(undef)

By default, an object has neither a protocols_allowed list, nor a protocols_forbidden list.

Note that having a protocols_allowed list causes any protocols_forbidden list to be ignored.

[/indent]This information is at http://search.cpan.org/~gaas/libwww-perl-5.805/lib/LWP/UserAgent.pm

Have you tried setting protocols_allowed?

Dave

iw_store

What errors are you getting, specifically?

CPAN's documentation on LWP::UserAgent suggests that HTTPS is possible:

[indent]

$ua->protocols_allowed( \@protocols )
This reads (or sets) this user agent's list of protocols that the request methods will exclusively allow. The protocol names are case insensitive.

For example: $ua->protocols_allowed( [ 'http', 'https'] ); means that this user agent will allow only those protocols, and attempts to use this user agent to access URLs with any other schemes (like "ftp://...") will result in a 500 error.

To delete the list, call: $ua->protocols_allowed(undef)

By default, an object has neither a protocols_allowed list, nor a protocols_forbidden list.

Note that having a protocols_allowed list causes any protocols_forbidden list to be ignored.

[/indent]This information is at http://search.cpan.org/~gaas/libwww-perl-5.805/lib/LWP/UserAgent.pm

Have you tried setting protocols_allowed?

Dave

Thanks Dave, I got

"501 Protocol scheme 'https' is not supported (Crypt: Smiley Frustrated

SLeay not installed) at mm.pl line 22"

I got this even if I set protocols_allowed.

I tried installing Crypt: Smiley Frustrated

SLeay like as shown below which I got from google, in my machine cpan is configured, so I am not able to do this.

perl -MCPAN -e 'install Crypt: Smiley Frustrated

SLeay'

Struggling to configure CPAN :-) when I go through UserAgent.pm it checks whether Crypt: Smiley Frustrated

SLeay installed or not, if not installed it won't accept https protocol.

And, when i try to install Crypt: Smiley Frustrated

SLeay, this package looks for openssl installation.
Agian I am stuck in installing openssl.

Any suggestions will be helpful.

Adam Stoller

What platform are you on (Windows or Unix)?
Are you trying to do this for TeamSite's iwperl - or for some other version of Perl?
Do you have a software development environment set up on your server where you are trying to do this (i.e.:

make, gcc, ld, as

, etc.)

Assuming Unix, for TeamSite's iwperl - you should probably just run:

% sudo `iwgethome`/iw-perl/bin/cpan

If, as you say, it is already configured, you should get the

cpan>

prompt and be able to type

install ****

. Ideally, when it was configured, cpan would have been set up to automatically, or at least via prompt, follow prerequisites so that you won't have to keep installing one module and trying it out to find out you need another module.

iw_store

What platform are you on (Windows or Unix)?
Are you trying to do this for TeamSite's iwperl - or for some other version of Perl?
Do you have a software development environment set up on your server where you are trying to do this (i.e.:
make, gcc, ld, as
, etc.)

Assuming Unix, for TeamSite's iwperl - you should probably just run:
% sudo `iwgethome`/iw-perl/bin/cpan
If, as you say, it is already configured, you should get the
cpan>
prompt and be able to type
install ****
. Ideally, when it was configured, cpan would have been set up to automatically, or at least via prompt, follow prerequisites so that you won't have to keep installing one module and trying it out to find out you need another module.

Thank you. I am on windows XP professional. Its not for teamsite, I have Active Perl installed in my machine version 5.8.8. My basic objective is to install Crypt: Smiley Frustrated

SLeay, to install this according to what I have read CPAN configuartion is required. In my machine I feel its not configured. When I try to configure CAPN by saying install capn I get following error.

cpan> install cpan
CPAN: Storable loaded ok
Going to read C:\Perl\cpan\Metadata
Warning: Found only 0 objects in C:\Perl\cpan\Metadata
CPAN: LWP::UserAgent loaded ok
Fetching with LWP:
http://ppm.activestate.com/CPAN/authors/01mailrc.txt.gz
LWP failed with code[404] message[Object Not Found]
Fetching with LWP:
http://cpan.perl.org/authors/01mailrc.txt.gz
LWP failed with code[500] message[Can't connect to cpan.perl.org:80 (Bad hostname 'cpan.perl.org')]
No external ftp command available
Please check, if the URLs I found in your configuration file
(http://ppm.activestate.com/CPAN, http://cpan.perl.org) are valid. The
urllist can be edited. E.g. with 'o conf urllist push ftp://myurl/'
Could not fetch authors/01mailrc.txt.gz
Fetching with LWP:
http://ppm.activestate.com/CPAN/modules/02packages.details.txt.gz
LWP failed with code[404] message[Object Not Found]
Fetching with LWP:
http://cpan.perl.org/modules/02packages.details.txt.gz
LWP failed with code[500] message[Can't connect to cpan.perl.org:80 (Bad hostname 'cpan.perl.org')]
No external ftp command available
Please check, if the URLs I found in your configuration file
(http://ppm.activestate.com/CPAN, http://cpan.perl.org) are valid. The
urllist can be edited. E.g. with 'o conf urllist push ftp://myurl/'
Could not fetch modules/02packages.details.txt.gz
Fetching with LWP:
http://ppm.activestate.com/CPAN/modules/03modlist.data.gz
LWP failed with code[404] message[Object Not Found]
Fetching with LWP:
http://cpan.perl.org/modules/03modlist.data.gz
LWP failed with code[500] message[Can't connect to cpan.perl.org:80 (Bad hostname 'cpan.perl.org')]
No external ftp command available
Please check, if the URLs I found in your configuration file
(http://ppm.activestate.com/CPAN, http://cpan.perl.org) are valid. The
urllist can be edited. E.g. with 'o conf urllist push ftp://myurl/'
Could not fetch modules/03modlist.data.gz
Going to write C:\Perl\cpan\Metadata
Warning: Cannot install cpan, don't know what it is.
Try the command
i /cpan/
to find objects with matching identifiers.
cpan>

Here what I have to do is LWP::UserAgent module should accept https protocol.

Another help is it possible to setup software development environment set up on my windows machine to run these command

make, gcc, ld, as

, I really don't know this.

nipper

A couple points, you will need some development enviromment (like Visual Studio) for make, c, etc. You can also download gcc.

Second, are you trying this at work ? Through a proxy ? I have never gotten cpan to work through a proxy, always have had to do it at home, hotel, etc. The ports (ftp) used are often blocked.

Someone may know how to configure cpan to use port 80 and a proxy, but i have never tried.

Good luck, this is time consuming, but if you are persistant you should be able to get it done. Though if you look at some of the older threads about DBI and perl (that went in the 60 some replies), you can see it takes a while and the incremental steps are often small.

Andy

Adam Stoller

Thank you. I am on windows XP professional. Its not for teamsite, I have Active Perl installed in my machine version 5.8.8. ...

If you're using ActiveState Perl - and especially if not for TeamSite - you should probably be using PPM instead of CPAN.

I don't have any documentation for that on my system (I use a Mac) - but you should be able to find some - perhaps just type

ppm

and you'll probably get a prompt from which you can type either help or ? or something like that - I believe the commands are fairly similar, so there's probably an install option.

iw_store

If you're using ActiveState Perl - and especially if not for TeamSite - you should probably be using PPM instead of CPAN.

I don't have any documentation for that on my system (I use a Mac) - but you should be able to find some - perhaps just type
ppm
and you'll probably get a prompt from which you can type either help or ? or something like that - I believe the commands are fairly similar, so there's probably an install option.

You are right. I am able to install all other modules except 'Crypt-SSLeay' this I need to make HTTPS protocol to work with Active Perl according to link http://johnbokma.com/perl/https.html.

I am able to install other modules by downloading from http://ppm.activestate.com/PPMPackages/zips/8xx-builds-only/Windows/ and by firing
ppm install packagename.ppd which I will find in readme file.

When I do same procedure for 'Crypt-SSLeay' it says no repository found, inturn this module is not there, in that location to download.

Again to install this module I have to have "openssl" installed in my machine. When I go through installation guide It's quite tidious process. No luck, stuck in between :-)).

Still trying to find one or otherway to make activeperl to accept https protocol.

Migrateduser

Hi All,

I am too trying to install the Crypt Smiley Frustrated

Sleay but am faced with lot of problems. I am using Activeperl V5.8.8. on WIndows XP. I have succefully installed the Openssl on my system. I am trying to install the module using ppm. Following are the steps i followed.

1) Installed Openssl from Openssl.org.
2) Downloaded the Crypt: Smiley Frustrated

SLeay module from the in .tar format and unzipped the files into c:/perl/lib/Crypt-SSLeay-0.53 folder.
3) Downloaded the Nmake15.exe and ran it in the above directory.
4) Then using the Nmake.exe tried to create the ppd but the following exception was thrown!

===========================================================================
C:\Perl\lib\CRYPT-~1.53>nmake
Microsoft (R) Program Maintenance Utility Version 1.50
Copyright (c) Microsoft Corp 1988-94. All rights reserved.
cl -c -Ic:\openssl\include -Ic:\openssl\inc32 -nologo -GF -W3 -MD -Zi
-DNDEBUG -O1 -DWIN32 -D_CONSOLE -DNO_STRICT -DHAVE_DES_FCRYPT -DNO_HASH_SEED -DU
SE_SITECUSTOMIZE -DPERL_IMPLICIT_CONTEXT -DPERL_IMPLICIT_SYS -DUSE_PERLIO -DPERL
_MSVCRT_READFIX -MD -Zi -DNDEBUG -O1 -DVERSION=\"0.53\" -DXS_VERSION=\"0.53\
" "-IC:\Perl\lib\CORE" SSLeay.c
'cl' is not recognized as an internal or external command,
operable program or batch file.
NMAKE : fatal error U1077: 'C:\WINDOWS\system32\cmd.exe' : return code '0x1'
Stop.
===========================================================================

I also tried another method

1) I tried ppm> install http://theoryx5.uwinnipeg.ca/ppms/Crypt-SSLeay.ppd but i got the following error!
===========================================================================
ppm install failed: 404 Not Found
===========================================================================
for this i also have set HTTP_proxy ,HTTP_proxy_usr and HTTP_proxy_pass environment variables... but still i get the same error.

I tried downloading this ppd and store it on my local machine and then re fire the install c:/Crypt-SSLeay.ppd but that too doesn't work.

CAn somebody point out wher am i going wrong!

Thanks and regards
Dixit

Adam Stoller

...
3) Downloaded the Nmake15.exe and ran it in the above directory.
4) Then using the Nmake.exe tried to create the ppd but the following exception was thrown!

===========================================================================
C:\Perl\lib\CRYPT-~1.53>nmake
Microsoft (R) Program Maintenance Utility Version 1.50
Copyright (c) Microsoft Corp 1988-94. All rights reserved.
cl -c -Ic:\openssl\include -Ic:\openssl\inc32 -nologo -GF -W3 -MD -Zi
-DNDEBUG -O1 -DWIN32 -D_CONSOLE -DNO_STRICT -DHAVE_DES_FCRYPT -DNO_HASH_SEED -DU
SE_SITECUSTOMIZE -DPERL_IMPLICIT_CONTEXT -DPERL_IMPLICIT_SYS -DUSE_PERLIO -DPERL
_MSVCRT_READFIX -MD -Zi -DNDEBUG -O1 -DVERSION=\"0.53\" -DXS_VERSION=\"0.53\
" "-IC:\Perl\lib\CORE" SSLeay.c
'cl' is not recognized as an internal or external command,
operable program or batch file.
...

You installed 'nmake' but you never installed a compiler - I believe you need to install something like the MSSDK - I've done very little development on Windows, perhaps someone else can point the way.