Author: masnun

Python

Building A Proxy Scraper with 15 lines of Python

Post author By masnun
Post date March 18, 2010
2 Comments on Building A Proxy Scraper with 15 lines of Python

Yes, Python is great! It’s beautiful and so on…. I have described the power of Python many times. For now, just the codes 🙂 Here’s a proxy scraper I built a few moments ago. It scrapes the web page at proxy-hunter.blogspot.com and lists the available open proxies.

#!/usr/bin/env python

from BeautifulSoup import BeautifulSoup as Soup
import re, urllib

url = 'http://proxy-hunter.blogspot.com/2010/03/18-03-10-speed-l1-hunter-proxies-310.html'
document = urllib.urlopen(url)
tree = Soup(document.read())
regex  = re.compile(r'^(\d{3}).(\d{1,3}).(\d{1,3}).(\d{1,3}):(\d{2,4})')
proxylist = tree.findAll(attrs = {"class":"Apple-style-span", "style": "color: black;"}, text = regex)
data = proxylist[0]
for x in data.split('\n'):
        print x

#!/usr/bin/env python

from BeautifulSoup import BeautifulSoup as Soup

import re, urllib

url = 'http://proxy-hunter.blogspot.com/2010/03/18-03-10-speed-l1-hunter-proxies-310.html'

document = urllib.urlopen(url)

tree = Soup(document.read())

regex = re.compile(r'^(\d{3}).(\d{1,3}).(\d{1,3}).(\d{1,3}):(\d{2,4})')

proxylist = tree.findAll(attrs = {"class":"Apple-style-span", "style": "color: black;"}, text = regex)

data = proxylist[0]

for x in data.split('\n'):

print x

It uses the BeautifulSoup package for parsing HTML. On ubuntu install it with this command:

sudo apt-get install python-beautifulsoup

1	sudo apt-get install python-beautifulsoup

On other platforms, grab the package from its homepage. Google is there to find the URL for you 😉

Python

Using Python on Hostmonster, Umbrahosting And Other General Shared Hosting

Post author By masnun
Post date March 11, 2010
1 Comment on Using Python on Hostmonster, Umbrahosting And Other General Shared Hosting

I’ve a hostmonster and umbrahosting shared hosting where my sites are running smoothly in PHP. I’m perfectly happy with both UmbraHosting and HostMonster. Additionally both the hosting providers have Python support. Being a Python enthusiast, I decided to check out.

On both Hostmonster and Umbrahosting, you can execute Python scripts as CGI scripts. But you must take care of these points:

— They must be placed inside the cgi-bin directory.
— Permission should be 755. (777 triggered server error for me)

I didn’t find the latest version of Python anywhere on these two hosts. Let alone Python 2.5, they have Python 2.4. 🙁 But still I’m happy that I can run Python. The only thing that I didn’t like was the obligation to put my scripts in the cgi-bin directory. So, I couldn’t have URLs like https://masnun.com/hello.py 🙁

Later today afternoon, an idea clicke in my mind. Can’t I target a subdomain to the cgi-bin directory? The answer is: YES! Just use a .htaccess file to map certain urls to your cgi-bin directory.

<ifModule mod_rewrite.c>
RewriteEngine On
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteRule (.*) cgi-bin/$1 [L]
</ifModule>

RewriteEngine On

RewriteCond %{REQUEST_FILENAME} !-f

RewriteCond %{REQUEST_FILENAME} !-d

RewriteRule (.*) cgi-bin/$1 [L]

</ifModule>

Putting the .htaccess in your domain’s root directory will allow you to put a python file inside your cgi-bin directory and visit it from http://example.com/example.py 😀

PHP

Sending SMS With AloAshbei Platform (GP APIs) and PHP

Post author By masnun
Post date February 4, 2010
6 Comments on Sending SMS With AloAshbei Platform (GP APIs) and PHP

Here’s a working example of Grameen Phone’s AloAshbei Platform.

<?php
/*
* Demo of the SMS API
* Author: maSnun
* URL: https://masnun.com
*/


// I hosted the WSDL on my own host
$soap = new SoapClient("https://masnun.com/wsdl/wsdl.php");

// Set the parameters in an array

$a['registrationID'] = "masnun";
$a['password'] = "******";
$a['sourceMsisdn'] = '8801711960803';
$a['destinationMsisdn'] = '88017********';
$a['smsPort'] = 7424;
$a['msgType'] = 4;
$a['charge'] = 2.00 ;
$a['chargedParty'] = '8801711960803';
$a['contentArea'] = 'gpgp_psms';
$a['msgContent'] = 'Hello GP API!';


try {
    var_dump( $soap->sendSMS( array ("SendSMSRequest" => $a) ) );
} catch (Exception $e) {

    var_dump($e->getMessage());

}

?>

<?php

* Demo of the SMS API

* Author: maSnun

* URL: https://masnun.com

// I hosted the WSDL on my own host

$soap = new SoapClient("https://masnun.com/wsdl/wsdl.php");

// Set the parameters in an array

$a['registrationID'] = "masnun";

$a['password'] = "******";

$a['sourceMsisdn'] = '8801711960803';

$a['destinationMsisdn'] = '88017********';

$a['smsPort'] = 7424;

$a['msgType'] = 4;

$a['charge'] = 2.00 ;

$a['chargedParty'] = '8801711960803';

$a['contentArea'] = 'gpgp_psms';

$a['msgContent'] = 'Hello GP API!';

try {

var_dump( $soap->sendSMS( array ("SendSMSRequest" => $a) ) );

} catch (Exception $e) {

var_dump($e->getMessage());

}

Example Response:

masnun@ubuntu:~$ cd random
masnun@ubuntu:~/random$ php gpsoap.php
object(stdClass)#2 (1) {
  ["SendSMSResponse"]=>
  object(stdClass)#3 (2) {
    ["status"]=>
    string(2) "OK"
    ["msgID"]=>
    string(17) "20100204183047653"
  }
}
masnun@ubuntu:~/random$

masnun@ubuntu:~$ cd random

masnun@ubuntu:~/random$ php gpsoap.php

object(stdClass)#2 (1) {

["SendSMSResponse"]=>

object(stdClass)#3 (2) {

["status"]=>

string(2) "OK"

["msgID"]=>

string(17) "20100204183047653"

}

masnun@ubuntu:~/random$

Recent Posts

Recent Comments

Archives

Categories