Python and .NET playing together!

* * * * * 1 votes
June 27th, 2008

Intro

Lately my head has been up in the clouds playing around with a few languages, Python, C#, and Java (we'll get into Java later) as I usually do for fun and I thought how fun would it be to mix them!

Of course this is nothing new. There have been interpreters to mix and match them all you like for some time now and in this blog we'll focus on Python and .NET for now.

IronPython

IronPython is an implementation of the Python interpreter written completely in .NET. Being that it is written in .NET you can access all the .NET libraries with the interpreter and run it on any platform.

To run IronPython on any other than MS Windows (*nix, Mac, etc) you will need to install Mono. Mono provides the necessary software to run and develop .NET software on other platforms.

Note: The Mac package of Mono comes with IronPython. If you are on *nix you can probably find a package for your distro or have to compile it for yourself. If you are on MS Windows you can get the latest .NET run time from your Windows Update.

It takes two to tangle!

So after all that babble lets get started! Out of all the .NET languages I am currently most familiar with C# so I'm going to be taking some C# examples and showing you how to do them with Python using the IronPython interpreter which is invoked via the ipy command.

We'll start first with the ever so boring "Hello World" program.

In C# we would do something like this:

using System;
 
public class HelloWorld
{
	public static void Main()
	{
		Console.WriteLine("Hello Richard!");
	}
}

The above code should be extremely obvious, if not I suggest some polishing up of your C# skills.

Now with Python, I'm going to write the same exact thing (minus wrapping it in a class since its unnecessary with Python at this point) and I'm going to output "Hello Richard" using the same C# libraries:

from System import *
 
Console.WriteLine("Hello Richard")

That's it! An extremely simple 2 lines! Not bad huh? Of course that was cool but not something so useful.

All we've done was imported the System library into the current name space. We could have also done import System but then we would have had to write the whole System.Console.WriteLine() command. In some cases that might be useful if you don't want certain things to conflict.

Now lets do something a little more cool like interacting with a DLL created completely in .NET. If you want to know how to create a DLL file yourself then Google it but for now I'm going to take one already made.

For this example I'm going to use the MySQL .NET Connector and query some junk from my database.

Here would be the C# way (borrowed from here):

using System;
using System.Data;
using MySql.Data.MySqlClient;
 
public class Test
{
	public static void Main(string[] args)
	{
		string connectionString =
			"Server=localhost;" +
			"Database=test;" +
			"User ID=myuserid;" +
			"Password=mypassword;" +
			"Pooling=false";
 
		IDbConnection dbcon;
		dbcon = new MySqlConnection(connectionString);
		dbcon.Open();
		IDbCommand dbcmd = dbcon.CreateCommand();
		// requires a table to be created named employee
		// with columns firstname and lastname
		// such as,
		//        CREATE TABLE employee (
		//           firstname varchar(32),
		//           lastname varchar(32));
		string sql =
			"SELECT firstname, lastname " +
			"FROM employee";
		dbcmd.CommandText = sql;
		IDataReader reader = dbcmd.ExecuteReader();
		while(reader.Read()) {
			string FirstName = (string) reader["firstname"];
			string LastName = (string) reader["lastname"];
			Console.WriteLine("Name: " +
				FirstName + " " + LastName);
		}
		// clean up
		reader.Close();
		reader = null;
		dbcmd.Dispose();
		dbcmd = null;
		dbcon.Close();
		dbcon = null;
	}
}

Now, lets do this the Python way with the same rules as the last example; using the same C# libraries.

import clr
clr.AddReferenceToFile("MySql.Data.dll") # MySql.Data.dll must be located in the same directory as this script
 
from System import *;
from MySql.Data.MySqlClient import *;
 
connStr = (
	"Server=localhost;"
	"Database=test;"
	"User ID=myuserid;"
	"Password=mypassword;"
	"Pooling=false"
)
 
conn = MySqlConnection(connStr)
conn.Open()
cmd = conn.CreateCommand()
"""
requires a table to be created named employee
with columns firstname and lastname
such as,
   CREATE TABLE employee (
      firstname varchar(32),
      lastname varchar(32));
"""
sql = "SELECT firstname, lastname FROM employee"
cmd.CommandText = sql
reader = cmd.ExecuteReader()
while reader.Read():
	firstName = reader["firstname"]
	lastName = reader["lastname"]
	Console.WriteLine("Name: %s %s" % (firstName, lastName));
 
# clean up
reader.Close()
reader = None
cmd.Dispose()
cmd = None
conn.Close()
conn = None

And walla! You have to admit, that is pretty awesome! We've got the power of simplicity from Python along with the power of .NET at our finger tips!

You can also import libs that you've gac'd (installed via gacutil) by replacing line 2 with clr.AddReference("MySql.Data") which might be more useful in some cases.

Conclusion

There's so much we can do with this such as prototype, making simple test cases, or even utilities for your .NET application. I've found this lots of fun and hope you do too. Stay tuned and keep your eyes peeled for another article on roasting the same blend of code with Jython!

Be sure to also take a look at these other links that might interest you as well!

Share/Save/Bookmark

MySQL NDB Cluster Engine Startup Script for openSuSE

          0 votes
May 14th, 2008

Finally took the time to setup an official project on Sourceforge to host this little startup script for MySQL's NDB Cluster Database Engine. When I'm even less lazier i'll fix my server and move my open source SVN projects there.

You can grab the latest code from the project URL below. I'd recommend just getting whatever is the latest code in trunk and I'll continue to maintain the script(s) until our platform specific packages start coming out with their own start up scripts.

Project URL: http://sourceforge.net/projects/ndb-initializer/

SVN URL: https://ndb-initializer.svn.sourceforge.net/svnroot/ndb-initializer

Please post up if you you another flavor of *nix and it works or if you are able to port it to another flavor.

Installation instructions located in script source.

Share/Save/Bookmark

Compiling MySQL-Python on Mac OS X

          0 votes
May 6th, 2008

Compiling is so 80s and not the Mac way :???: . If any system should have packages for everything it should be Mac! Well, before I drift off into why I think there should be packages for everything lets get back on topic.

I did this with Mac OS X 10.5 (Leopard) but it should work with older versions (and newer ones). If you tried them and they work please post up!

Developer Utils

If you haven't already, find your install disc of Mac OS X and poke through it and install Developer Tools. You can also download it from ADC (Apple Developer Connection) for free from here. You'll need to do that before continuing.

MySQL

Next you'll need to download the latest stable version of MySQL from here (version 5.0.45) as of this writting. Unpack it by double clicking it, install, blah blah blah.

MySQL-Python

Lastly, download the latest mysql-python from here (version 1.2.2 as of this writting). Unpack it by double clicking and open up _mysql.c in your favorite text editor as they usually say.

Find the following lines and delete them (line ~36):

#ifndef uint
#define uint unsigned int
#endif

Next find these following lines:

uint port = MYSQL_PORT;
uint client_flag = 0;

... and chane them to:

unsigned port = MYSQL_PORT;
unsigned client_flag = 0;

Some people reported having problems trying to build this because for some odd reason they are missing a `mysql` link in its lib directory to itself. Peek inside of /usr/loocal/mysql/lib and see if you have a symbolic link named `mysql` pointing to itself. If you don't, open up your Terminal and run the following command:

sudo ln -s /usr/local/mysql/lib /usr/local/mysql/lib/mysql

We're almost done :) Open up your Terminal into the directory you unpacked mysql-python and run the following:

python setup.py build
sudo python setup.py install

Thats it! Enjoy!

Share/Save/Bookmark

Compiling PHP on Mac OS X

* * * * * 4 votes
March 29th, 2008

Getting Started

You may want to recompile PHP on your Mac for a number reasons such as need a newer version, missing some features you need, testing, or whatever. Some of the most common reasons I found were people needing GD support because the version of PHP that comes with Mac OS X doesn't have it. In this I'll let you know what you need and how to get it done.

Apache

We'll need to recompile Apache even though it already comes with our system because for some unknown reason (to me) the compiled version of Apache that comes with our systems doesn't play too well when we compile PHP. Anyways without going into further details, read through this article real quick, Compiling Apache on Mac OS X, and come back here. Should only take ya like 5 minutes...

Time for PHP

Welcome back! Next, download the latest copy of the PHP source (5.2.5 as of this writting) compressed in tar.gz format from this URL, http://www.php.net/downloads.php. Once complete and you don't care about compiling PHP with any other options such as GD Support, MySQL, etc, and you just want the basic PHP then you can go back to your Terminal, cd into the directory where you downloaded PHP and run the following commands:

$ tar -xvzf php-5.2.5.tar.gz
$ cd php-5.2.5
$ ./configure --enable-layout=Darwin --enable-mods-shared=all --prefix=/usr --mandir=/usr/share/man --localstatedir=/var --infodir=/usr/share/info --disable-dependency-tracking --with-apxs2=/usr/sbin/apxs --with-kerberos=/usr --enable-cli
$ make
$ sudo make install

Like Apache, you would need your root password to install PHP with the last command. Once everything is complete you can go into Sharing from your System Preferences and restart Web Sharing and you will notice you are running the version of PHP that you downloaded!

Note: Whenever editing your apache configuration you will need to restart it in order to see the new changes.

If you do want to build PHP with additional features then proceed below and follow the setup of instructions for each and either feature. For starters we can unpack PHP.

$ tar -xvzf php-5.2.5.tar.gz

Later when I say to build PHP with whatever ./configure command I just mean running the command from your Terminal while being in the directory where you unpacked PHP.

GD Support?

I won't leave you hanging wondering how to install GD since I brought it up earlier and its quite easy so lets do it! If you want jpeg support with GD then you need to install libjpeg. You can download the latest stable source code from http://www.ijg.org/files/. Once you get it go back to your terminal and run the following commands:

$ tar -zxvf jpegsrc.v6b.tar.gz
$ cd jpeg-6b
$ cp /usr/share/libtool/config.sub .
$ cp /usr/share/libtool/config.guess .
$ env CFLAGS="-O -g -arch i386 -arch ppc" LDFLAGS="-arch i386 -arch ppc" ./configure --prefix=/usr --sysconfdir=/etc --localstatedir=/var --mandir=/usr/share/man --enable-shared --enable-static
$ make
$ sudo make install
$ sudo ranlib /usr/local/lib/libjpeg.a

That's that for libjpeg. Now if you also want png support we need to grab libpng from http://www.libpng.org/pub/png/libpng.html. When done, lets go back into our terminal and run the following commands:

$ tar -xvzf libpng-1.2.22.tar.gz
$ cd libpng-1.2.22
$ env CFLAGS="-O -g -arch i386 -arch ppc" LDFLAGS="-arch i386 -arch ppc" ./configure --prefix=/usr --sysconfdir=/etc --localstatedir=/var --mandir=/usr/share/man --disable-dependency-tracking
$ make
$ sudo make install
$ sudo ranlib /usr/local/lib/libpng.a

Alright all set! Now we just have to go back to PHP and configure it with the options for GD. Below is the command:

$ ./configure --enable-layout=Darwin --enable-mods-shared=all --prefix=/usr --mandir=/usr/share/man --localstatedir=/var --infodir=/usr/share/info --disable-dependency-tracking --with-apxs2=/usr/sbin/apxs --with-kerberos=/usr --enable-cli --with-jpeg-dir=/usr/local/bin --with-png-dir=/usr/local/bin --with-gd

All I added were the last 3 options. If you didn't add libjpeg or libpng then you can remove them from the options respectively. After done configuring just remember to make and make install and your done!

MySQL

What PHP build would be complete without MySQL support? This step is super easy, simply go to http://www.mysql.com and download the latest stable version (5.0.45 as of this writing) for your platform and install it. The installation will place the files in a mysql directory in /usr/local. You can see which directory it was installed in by running the following command:

$ ls -lah /usr/local | grep mysql

Now that you've got the MySQL installation directory its helpful to create an alias directory without the version number at the end that will point to your current working version. This is also helpful so you can install multiple versions of software and when you want to switch between them you could simply change where the alias points to. If your MySQL directory was installed to /usr/local/mysql-5.0.45-osx10.4-i686 then this would be your command to create an alias:

$ sudo ln -s /usr/local/mysql-5.0.45-osx10.4-i686 /usr/local/mysql

Also, if you would like to access MySQL from the command line without having to type the full path to the binaries each them then I'd recommend appending your MySQL path to your $PATH environment variable:

$ echo "export PATH=\$PATH:/usr/local/mysql/bin" >> ~/.profile

The above line appends MySQL to your $PATH environment variable and from here on every Terminal window you open will find its way to MySQL.

Continuing on with PHP, depending which MySQL support you want (MySQL, MySQLi, PDO, or all) then just pick out whatever you want and don't want from the line below:

--with-mysql-sock=/var/mysql --with-mysqli=/usr/local/mysql/bin/mysql_config --with-mysql=/usr/local/mysql --with-pdo-mysql=/usr/local/mysql

Conclusion

There are many more options you can add to the configure script to set certain features. To view all the options available you can run ./configure --help and that will spit out just about all the ways you can configure your build. Below is the configure command I used:

$ ./configure --enable-layout=Darwin --enable-mods-shared=all --prefix=/usr --mandir=/usr/share/man --localstatedir=/var --infodir=/usr/share/info --disable-dependency-tracking --with-apxs2=/usr/sbin/apxs --with-ldap=/usr --with-kerberos=/usr --enable-cli --with-zlib-dir=/usr --enable-trans-sid --with-xml --enable-exif --enable-ftp --enable-mbstring --enable-mbregex --enable-dbx --enable-sockets --with-iodbc=/usr --with-curl=/usr --with-config-file-path=/etc --sysconfdir=/private/etc --with-mysql-sock=/var/mysql --with-mysqli=/usr/local/mysql/bin/mysql_config --with-mysql=/usr/local/mysql --with-xmlrpc --with-xsl=/usr --with-pdo-mysql=/usr/local/mysql --enable-soap --with-pear --with-jpeg-dir=/usr/local/bin
--with-png-dir=/usr/local/bin --with-gd

Its also important to note that when doing system updates, not just little security updates or other application updates, but big critical system updates that brings you from something like 10.5.0 to 10.5.1 might rid your Apache and/or PHP setup. Nothing bad will happen, they will just overwrite your setup with their update. If you happened to keep your build then you can just go back and run sudo make install or you can just download the latest versions of the software we used here and redo the steps.

Share/Save/Bookmark