Empowering Nederlandse Spoorwegen (NS) to develop and manage XR app

Nederlandse Spoorwegen (NS) transports over 1 million passengers daily on the Dutch railway network, which makes it the largest passenger carrier in the country. The organization’s headquarters are located in Utrecht, the heart of the Dutch rail network. At the carrier, over 21,000 professionals, including more than 3,000 head conductors, work daily to ensure train traffic runs smoothly.

NS is fully committed to innovation with Extended Reality (XR). After an innovation phase, it has been proven that this technology offers enormous opportunities in various fields. Therefore, NS is taking the next step in XR: from innovation to industrialization.

In-house XR product capability

How could NS fully utilize the capabilities of XR for a wide range of applications? The client needed XR product capability in-house, to develop XR applications itself. Secondly, NS wants to be able to guarantee the continuity of these applications, essential to be able to continue to deploy XR in a correct and safe manner. Therefore, the transport operator also required in-house XR support.

NS wanted to be able to build XR applications modularly using technical building blocks. Developers can then reuse these when developing new XR applications. Additionally, NS wanted to be able to develop applications with a super-realistic user experience. After all, if a virtual experience does not correspond to reality, an XR application loses its usefulness and can become a gimmick.

NS selected various processes for which it wanted to deploy XR technology. The first application is a training environment for head conductors, in which they can be trained in XR on the departure process. This training was previously conducted on physical door simulators that are due for replacement in the future. Training within a virtual environment offers a scalable and future-proof solution that is no longer dependent on physical equipment at a single location. Currently, this XR training is being used as a pilot by all head conductors.

Why Sogeti?

As the leading XR specialist in the Netherlands, Sogeti is the ideal partner to set up an in-house product capability for this technology. Furthermore, Sogeti is capable of realizing a realistic XR user experience. NS was inspired after seeing the digital cockpit developed and tested by Sogeti at KLM. In addition to experience, Sogeti also has the right professionals in-house to develop XR product capability, including technical support.

In-housing

Sogeti supported NS with the in-housing, among other things by realizing the right way of working that enables NS to manage and further develop XR applications itself. This explicitly involves not only development, but the complete set-up of product capability: compliance, security, architecture, processes, and development standards. In addition, Sogeti handled the peripheral matters essential for continuity, such as those related to privacy, security, and workplace support. To make the user experience as realistic as possible, Sogeti taught NS how end users can be involved in the development.

XR in practice

Together with NS, Sogeti developed the first XR application: a training application for chief conductors. Sogeti contributed ideas regarding the scope and technical implementation. Subsequently, a team of three Unity Developers and a 3D Modeler got to work. Within approximately six months, they built a fully functional application that will run as a pilot until 2026 and will then go officially live. A working group of conductors was involved in the development., to test the application during every development cycle. As a result, certain virtual actions have been fine-tuned in detail and are hyperrealistic. For example, conductors hear and feel a click when turning the cam key, just like in real life. The application is currently running as a pilot and is used by all chief conductors.

Together with NS, Sogeti developed the first XR application: VR refresher training on the departure process for chief conductors. Sogeti contributed ideas regarding the scope and technical implementation. Subsequently, a team of three Unity Developers and a 3D Modeler got to work. Within approximately six months, they built a fully functional application.

How does the application work?

Conductors put on XR headsets and see a virtual platform. Next, they select the train type and scenario. The conductors start in a tutorial environment, where they are familiarized with the virtual setting before beginning their training. Initially, conductors can be virtually trained using a VIRM double-decker at four locations and according to three training scenarios: a happy flow where everything proceeds as expected, a train door entrapment, and a technical malfunction. During the training, supervisors monitor the conductors’ virtual environment on a tablet. They can intervene in the event of problems. Afterwards, the conductors receive feedback from the XR application, optionally supplemented by the supervisor.

The added value of XR

The training application is a clear example of the added value that XR can offer. As a result, there is no longer a need to use the physical door simulators, which were due for replacement. Additionally, NS can train chief conductors much more effectively. Firstly, because the training location is closer to home. This means less travel time for conductors and supervisors. In the future, NS can easily add more training locations and rolling stock types. Secondly, more people can take a training course simultaneously, allowing them to learn more in less time. Thirdly, the virtual training is very comprehensive. NS can expand the application with new train types and training scenarios as needed.

In-house XR capability

NS now possesses in-house XR product capability and support capabilities. This enables the transport operator to develop and manage XR applications itself. This capability includes, among other things, established processes, compliance guidelines, security requirements, development standards, and architectural agreements necessary to deploy XR in a secure and future-proof manner. The training application for conductors is the first proof of this. NS can also build XR applications modularly, just as was done with the training application. This makes it possible to develop new applications relatively easily and cost-effectively using reusable building blocks and models. The development and management expertise for this is also available internally

Future applications

The transport operator is currently investigating where further improvements can be made using XR. For instance, they are looking at equipment maintenance and streamlining operational work processes. The training application is also being expanded: conductors can train virtually with an increasing amount of rolling stock. The first XR application has also had an additional positive effect. Due to the hyperrealistic virtual training and rapid rollout, the reactions from within the organization have been very positive. As a result, budget is becoming available sooner for new applications. So, in this area too, NS has everything in place to set the XR train in motion.