For those who have been using the updated version of Wordpress which is the 2.5.1 like me, there have been issues on the Permalink Structure not working.