Evaluation

To a great extent, the success of Transport Direct will be determined by the quality and attractiveness of the transport services that it recommends to the user of the site. It is proposed, however, that the following measures be adopted to assess the effectiveness of Transport Direct.

  • Initial achievement of one million unique visitor sessions in the first year of operation to confirm visibility and usage.  This was achieved in June 2005.
  • A goal of ten million unique visitor sessions by 2006 to establish Transport Direct as a major source of transport information. This was achieved on 1st December 2006.
  • A referral rate of 2-3% of site users to retailing sites, which shows the effectiveness of encouragement to purchase tickets on-line. 
  • The achievement of modal change requires delivery of wider transport objectives (e.g. improving the quality of public transport provision), but a 2-3% point change would represent a 15-20% increase in the use of public transport.
  • Questioning of “habitual” choice; Indicated by research into site-users’ behaviour showing that 10% reconsidered their choice of mode (based on information provided) prior to making their final journey.
  • Use of real-time information to make an informed modal choice; Shown by 10% of real-time users agreeing that they re-considered their original journey plan.
  • User benefits were measured by research, but the advantages that came from the research outweigh the cost of acquiring the information.

The Evaluation Project was aimed to assess the impact of the Transport Direct Programme.

Three questions it asked were:

1. What contribution has the Programme made to the Government's objective of making better use of existing rail and road infrastructure?
2. Does the overall level of travel information in the UK meet traveller's needs and expectations?
3. What is the public's attitude to Transport Direct and how satisfied are its customers with the service?

The first phase of the Project (Nov 02 - Oct 03) developed an initial evaluation framework which covers the full term of Transport Direct (period to 2011), while still focusing its attention on the first phase of the Programme (period 2000 to 2004).

The second phase of this Project established the baseline information that has become key to help quantify the Programme's outcomes and impacts.

The third phase carried out regular sets of reviews to calibrate where and how the programme is performing against this baseline. The first of these reviews was completed in May 2006 (nearly 18 months after the public launch of the Portal).

The Project is being led by AEA Technology, with support from Transport & Travel Research (TTR) Ltd.

Further evaluation conducted by VIPRE has looked at the challenges in monitoring and evaluating the Public's feedback concerning the travel information workplace.