RobsHouse.net

Drupal's file handling capabilities keep getting better. Beyond the core upload module, the filefield module for CCK has enabled us to build sites with all sorts of files; documents, images, music, videos, and so forth. Searching within these docuements, however, has never been a common feature on Drupal sites. Some solutions have existed, particularly for extracting texts from PDFs and common wordprocessing documents. With Apache Solr, the attachments module, and an extension library called Tika, things can be much better. With Tika you can extract texts not only from Microsoft Office, Open Office, and PDF documents, you can also get text and metadata from images, songs, Flash movies and zipped archives. Searching for these texts is done as part of the normal Apache Solr driven site search.

How refreshing it is when the US Government does something so right that my chest swells with pride and my heart fills with hope! How exciting it is that Drupal and Acquia can play a role in bringing openness to government. I’m referring to the Open Government Directive (OGD), an instruction from the President of the United States to all federal agencies to drastically change the way that government talks to and shares information with the public.

The OGD is predicated on three principles: transparancy, participation, and collaboration. Here I quote from the President’s website:

Transparency promotes accountability by providing the public with information about what the Government is doing. Participation allows members of the public to contribute ideas and expertise so that their government can make policies with the benefit of information that is widely dispersed in society. Collaboration improves the effectiveness of Government by encouraging partnerships and cooperation within the Federal Government, across levels of government, and between the Government and private institutions.

On top of these principles is a clarification of the baseline position that government agencies are to adopt, in particluar regarding the Freedom of Information Act (FOIA). Government agencies are instructed to presume openess and disclosure.

These instructions also come with teeth. There are concrete steps to be taken, and deadlines. Hard deadlines that are coming up fast. Each agency was given 45 days to identify three sets of data that had never been released before, and to make them available on Data.gov. In the same time agencies are to appoint a highlevel senior official to oversee the “quality and objectivity of, and internal controls over, the Federal spending information publicly disseminated through such public venues as USAspending.gov or other similar websites.” Those are big changes in a short time.

Within 60 days, agencies are to go even further, and launch portals on their websites, http://www.[agency].gov/open, which will keep the public informed of all their activity and efforts pertaining to the OGD. This also pertains to information and policies regarding the FOIA. There are also 60 and 120 day deadlines for the communication of frameworks for making Open Government systemic to the very DNA of government agencies. Changes include a “longer-term comprehensive strategy for Federal spending transparency”.

One particular goal, to be met in the first 45 days, summarizes the attitude towards technology and public participation:

[provide] a forum to share best practices on innovative ideas to promote participation and collaboration, including how to experiment with new technologies, take advantage of the expertise and insight of people both inside and outside the Federal Government, and form high-impact collaborations with researchers, the private sector, and civil society.

This is essentially saying that the government wants to collaborate with the public on the difficult issues facing us, and that modern technologies and tools (such as Drupal’s social publishing and collaboration tools) should be used where appropriate if they further the goal of fostering collaboration.

All of this is like fresh air. I work with open source software specifically because I believe in the value of transparancy, participation, and collaboration. The Drupal project is a shining example of what humans can achieve when they work together in this way. I am also thrilled that Acquia is already deeply involved in helping government agencies realize these goals, and that the tool that many are looking to as an Open Government Directive enabler, is Drupal. Acquia has a new Government JumpStart program, a whitepaper on Social Publising for Government, and an exciting partnership with Carahsoft to guarantee that we can meet the urgent needs of agencies in the throes of change.

Read more about Acquia’s OGD offerings and partnerships. Dana Blankenhorn covered Acquia, Drupal and OGD on ZDNet. Dries and Kieran have both written about Drupal and OGD on Acquia.com.

Edit: I totally had the dates wrong for the Drupal Developer Days in Munich - they’re May 5-7 :P

The Drupal-Initiative e.V. is a German non-profit organization dedicated to driving the growth of Drupal in German speaking countries. Yesterday was an important milestone for this group as we had our first ever planning sprint that was open to the public. The sprint was in Essen, in a neat location called the Unperfekthaus (the imperfect house), and we had 17 people from across Germany who came to help us plan, divide the work, take on responsibility, and breathe life into an organization which has until this point been the work of 5-6 individuals.

The history of the Drupal-Initiative starts in mid 2008 when members of the Cologne-Bonn Drupal Users Group decided to host a DrupalCamp in Cologne. We knew that we’d need some structures in place, such as a bank account, a website, and so forth. We also had our eyes on a bid to host the international DrupalCon in Germany at some point, so we thought that building a strong, formal entity, such as a non-profit organization, was the best way to achieve these goals.

Some months later, in January, 2009, we hosted DrupalCamp Cologne which saw over 200 people show up - a great success. Shortly after that we actually finished the legal proceedings, including becoming an e.V. (eingetragener Verein), and securing a license from Dries Buytaert to use the word “Drupal” in our name. Eventually we launched a membership program and have been quietly growing, with both individual and corporate memberships, ever since.

The planning sprint in Essen was the first time that we’d set out to involve our current members beyond the founding core, and to raise the level of awareness about what we do, and most importantly, how people can help. Some of the results of the sprint include:

1. We’re going to redesign the hastily created Drupal-Initiative.de website. We have a “Feuerwehr” team (Fire department) to attack the most obvious and easily fixed problems, and a long term team to do a proper needs assessment, design, and implementation of a comprehensive site.
2. We’re going to be involved in more national events. There are two events immediately on the horizon: DrupalCamp Essen in February 2010, and Drupal Developer Days Munich, in May 2010. Both of these events are now officially Drupal-Initiative events, which shows an unprecedented amount of cooperation amongst the German Drupal community.
3. We’re going to organize an effort to write a series of articles for the TN3 magazine to promote the launch of Drupal 7.
4. We’re going to start sending newsletter issues about Drupal and Drupal-Initiative activities. Sign up here if you’d like to get these.
5. We’re going to launch a site WarumDrupal.de (Why Drupal?) which will, similar to Drupal.com, be a shiny landing page and dispatcher for people looking for places to start.
6. We’re in the process of moving our sites and infrastructure from private servers to a server rented by the Drupal-Initiative, and to build a redundant and empowered team of sysadmins and developers who can maintain our current and future sites in a structured and sustainable way.
7. If Berlin is selected to host DrupalCon 2011, the Drupal-Initiative and it’s members will likely have a large role to play. We’re ready!

Special thanks to Daniel Niehaus for taking the lead with organizing the sprint. When you meet Daniel, make sure to ask him why his nickname is Jack Plain - it’s a worthy story =)

Drush and Drush Make belong in every Drupal developer's toolkit. This is a make file that will build the following:

1. Drupal 6.14 (or latest)
2. ApacheSolr module
3. SolrPhpClient hosted on code.google.com
4. Acquia Connector module (from Drupal.org)
5. Acquia Search module (from Acquia's svn repository)

This demonstrates four different methods for downloading code, from three different sources.

To execute, install Drush, install Drush Make, then run the attached file like this:

drush make search.make

To specify an output directory, add the path as an extra parameter:

drush make search.make /var/log/www

To see what's going on, use the -v flag for verbose output:

drush -v make search.make

Here's the content of the make file:

core = "6.x" 

projects[] = "drupal" 

projects[] = "acquia_connector"

projects[apachesolr][download][type] = "cvs"
projects[apachesolr][download][module] = "contributions/modules/apachesolr"
projects[apachesolr][download][revision] = "DRUPAL-6--2"

projects[acquia_search][type] = "module"
projects[acquia_search][download][type] = "svn"
projects[acquia_search][download][url] = "https://svn.acquia.com/drupal/branches/1.x-6.x/modules/acquia/acquia_search/"

libraries[SolrPhpClient][download][type] = "get"
libraries[SolrPhpClient][download][url] = "http://solr-php-client.googlecode.com/files/SolrPhpClient.r22.2009-11-09.tgz"
libraries[SolrPhpClient][destination] = "modules/apachesolr"

On October 22, 2009, I gave a keynote presentation at a digital marketing conference in Brussels. After my speech I was interviewed by the organizers of the conference. Here is the video. Note that my grandmother is actually 88, and really is on Facebook.

This month's issue of the print magazine and website PHP User (in German) features an article on Drupal's CCK and Views module. The article was written by Meinolf Droste of MDWP, an Acquia Silver Partner.

There are at least four magazines in Germany that sometimes feature Drupal in print articles. This puts Drupal onto the news stands in kiosks, grocery stores, and train stations throughout Germany. It's nice to see Acquia Partners taking such an active role in promoting Drupal. Great work!

Yesterday I gave a keynote presentation at the Digital Marketing First 09 trade show in Brussels, Belgium. Drupal was out in full force with four Belgian companies joining forces to make the conference a special Drupal-themed event. There were also a number of other companies present who are using Drupal.

To prepare for the event I made a micro-site that focuses on Drupal and interactive digital marketing (the theme of the conference). It features a directory of the companies that were present and some case studies about how Drupal is the ultimate integration platform for anyone who offers an online service or tool.

The DrupalVillage.be companies that were present:

• Krimson (Acquia partners)
• Connexion
• Coworks
• A Web Factory

Also present were:

• Emakina (Acquia partners)
• Siruna
• TheParkingLot.com (see their Drupal testimonial)

Special thanks to ICanLocalize.com for translating a portion of the micro-site content into Dutch and French.

My presentation was very well attended. The slides are below. The take away for me was that Drupal is a great tool for people doing digital marketing, and Drupal people should be attending marketing conferences (and vice versa).