I do governance for British railway IT plus European regulation
I believe data makes rail passengers lives better. Ask me how!
#Physicist
#OpenData
#DataScience
For those interested in such things, here are cuts of the
@railandroad
2021/22 passenger travel data projected onto a shortest-path network using the centre-line track-model with log and linear colour gradient and line width
Thanks to
@undertheraedar
@poggs
#rail
#DataVis
For those interested in such things based on the ORR Great Britain passenger origin-destination matrix, here is a short animation showing the change aggregated rail passenger flow in FY2019/20-2021/22
#DataVisualization
#rail
#PassengerTransport
#ChangeInDemand
Update: the 2 657 images showing the ORR 2021/22 passenger travel data for each of the active mainline railway stations here . The main code still needs work and will be posted on GitHub here
For those interested in such things, here are 2 657 images showing the ORR 2021/22 passenger travel data projected onto a shortest-path network for each of the active mainline railway stations
#DataVisualization
#Rail
#PassengerData
#ORR
#2021
1/2
For those interested in such things, here is a theoretical rail-network based on applying a minimum spanning tree to a series of scaled hexagon population distributions geographies
#RailNetwork
#DataVisualisation
#Census2021
Update: the site should be back here
Given the popularity I'm going to look at an alternative hosting solution but hopefully this will work for a bit.
Please shout if it isn't*
* As if you wouldn't
I would like to thank all the staff at
@YorkTeachingNHS
in York A&E and Day Admissions today for the kindness and care given to an anxious bloke with chest pains, and the reassurance it was skeletomuscular brought on by to stress at work rather than an acute coronary event
@undertheraedar
The fix is in, with 202 country files, 17 regions with 19,752MB of zip'd GeoPackage files for the 47.8M km of repackaged Microsoft road data
Code here
(14 of 17 processed regions data are also hosted)
Any further questions shout
For those interested in such things here is a draft set of UK rail planning (TIPLOC) and operations (STANOX) locations snapped to the centre-line track-model, or OpenStreetMap data where require
Code and data is here
#DataVisualisation
#rail
1/2
@SwissKrono_JH
@Coneee
@BloombergUK
No. It's GB not UK by design
The Irish dataset is not available otherwise I would have visualised that
For the absence of doubt, I did ask and told this is not available either for NI or elsewhere
For those that are interested in such things, I've published some details about the implementation, data, licensing and a cut of the code.
However it is "beta" at best and is also quite slow. So I'll run it overnight and see what the morning brings
@undertheraedar
For those interested in such things I've posted the code to GitHub here
The scripts are still running as the data is big and my computer is slow. I will update with addition countrries and regions as they become available
Any questions shout
For those who are interested in such things here is an animated GIF of maximum population hexagons based on Census 2021 across 10 edge lengths (484km, 183km, 69km, 26km, 9.9km, 3.7km, 1.4km, 532m, 201m and 76m) clipped to the GB network based on
For those interested in such things, here is an update to the TIPLOC (Timing Point LOCation) visualisations at York and Doncaster
Code, data and QGIS file here
#QGIS
#DataVisualization
#rail
@undertheraedar
Try this which has the Carribbean Islands and European data as GeoPKG files split by country using the three-alpha code
Basic data here is and I'll tidy up and post the
@python
code over the weekend
@undertheraedar
@railandroad
@poggs
Kudos to Alasdair. I merely took what Alasdair had done here and blinged it with some centre-line track-model shenanigans
(Corrected for spelling)
@undertheraedar
This might be interesting here () is a script that downloads Open Street Map (OSM) tagged "railway" data within Great Britain using the OverPass API (), the OSMNX () 1/2
@GarethDennis
SMH. I was surprised and taken aback by the vitriol. Small children are a tough gig and I have been there and done exactly the same as this myself when my two were small*
* as I used to live in Scarborough in almost exactly the same circumstances
It takes a village...
For those interested in such things here is a beta
#python
module "parenx" ("pare" + "nx") for linear (road and rail) network simplification, using buffering and image skeletonization or Voronoi polygons to identify a centre-line, and available via
#pip
The slides for my talk on timetabling and rail-freight are now available
This includes an online version and a PDF containing links and references to the material used
The video edit will be published shortly on YouTube
@ShefDigiFest
@Pixelfish
@crstry
Hence the Adora Belle Dearheart/Moist von Lipwig quote. The passage finishes:
"That had been a good day, Moist thought. At least, up until now it had been a good day...You weren’t supposed ever to meet the people afterwards. Gods damn Mr Pump and his actuarial concept of murder!"
If you are interested in UK rail timetabling, want to find about modal-shift or how rail-freight could help combat climate change, and have an hour free this may help
Slides are available here
@ShefDigiFest
#railway
#RailFreight
@25kV
I don't know if it helps but there are those who are inspired by your work and are following in your footsteps. Although probably rather too literally in this case
@25kV
@GarethDennis
@MrMappy
As a counterpoint to this, I wish I had a picture to hand of the OLE sidings visible on the S-Bahn between Wien-Mitte and the airport, that is a truly gibbering delight of freight electrification
(PS: I'll see if one of my ÖBB colleague has this...)
@MarcGra95162166
@thomasforth
While heavy rail is different, other than inconveniencing drivers why would you need to demolish any housing or infrastructure to accommodate a light-rail infrastructure? Also what is a tram station?
If you are still worried about impact you can always tunnel. See CrossRail
Why this may be of interest to the
#railway
#data
community is that the two examples chosen are the
#OpenData
CIF (Common Interface File) working timetable and TPS (Train Planning System) planning model datasets
For those interest in such things, here () is a script that downloads Open Street Map (OSM) tagged "railway" data within Great Britain using the OverPass API (), the OSMNX () python library and
@geopandas
1/2
The visualised data is in the GeoPKG (tiploc-location.gpkg) sx layer with ELR and approximate track offset based using centre-line data combined with OpenStreetMap
GeoPKG ox layer is snapped to the OSM network
#WhereIsMyTrain
@martinfleis
@undertheraedar
Update. Thank you for the suggestion as the 0.5.0 'pyogrio' fix is in and it is significantly faster than the base Fionas engine. The Caribbean Islands gives a 258% speed increase
@quantinghome
@undertheraedar
Yup. It's a naïve shortest-path routing using the centre-line track-model. I'm writing up the code now and'll get it on GitHub. Any code improvements would be welcome
@PeterMy53679910
@RailwayHeritage
@PermWayInstit
@GarethDennis
@RAIL
[*] Magyar Államvasutak, Hungarian State Railway
[**] Me: "What do you mean by saying that a track can have more that line gauge?"
Lazlo: "Yes, see this"
Me: "..."
(Sadly I don't have the picture)
I also understand it happens in Finland at the Russian border...
2/2
@saduncan1998
@undertheraedar
There is but involves a dataset for actual route taken rather than shortest path between two location on the network. Which I don't think exists
Also as some folk will go direct route you need to also say "85% went this way and 15% that." Which is hard
Happy to be proven wrong
I now deliver IT projects that will give HS2 a timetable to work with, LNER an easier way to divert a HST via Gainsborough when the powers out at Doncaster, spot a wobbly wagon that could derail at Fleet, or passengers at Brighton the train is 5 minutes early
#RailHumanLibrary
@undertheraedar
I wonder where the 50% line for England, Wales and Scotland would be. Unfortunately I have the 2021 Census data that could answer that question...
I just ran my first 5km
#ParkRun
at Harrogate park run in memory of my Sensei and friend Lance Saxby
"Those that the gods love die young"
He was a good man
@kooky_uk
@crstry
@b0rk
We had to reboot the whole of our corporate Windows estate and had complaints for months from corporate partners. Power off/power on was the fix. The power of the caching... 2/2
For those interested in such things, I've scraped the 2024 Timetable Planning Rules PDF from to text and (where possible) TSV, and gathered the platform-length data into a spreadsheet
#DataAnalytics
#PlatformLength
#TimeTable
@SimonZev
Unlike Gare St Lazare, Aachen, Wien Westbahnhof, Bordeaux St Jean et al, the GB national system of record CORPUS does not have a timing-point for Barcelona
Where CORPUS holds all records since its inception in the '80s/'90s
@mikeqfu
it was a really interesting talk today on the use of data science to answer problems about the railway. Thanks to
@robinlovelace
for the invite to
@ITSLeeds
@philatrail
I thought single-tender government contracts must pass a number of tests before they are let, which in my experience is quite a high bar
It would be interesting to see the assessment and guidance that led to this decision, especially given recent NAO criticism of HMG procurement
@rlonguk
@undertheraedar
Ah! You got me. The OpenRailData centre-line track-model doesn't have a path for the IoW to Portsmouth Harbour. While the ORR has ticket information I couldn't route the journey. As I didn't want to make stuff up I excluded it from the results
Happy to take suggestions
I have my next blog blog post about
#railway
things that interest me, here is my take on what a
#digitalrail
#TMS
is about
Comments or questions more than welcome
@Garret_Beggan
@RedFoxglove
@_lucymellor
I think this has already been addressed elsewhere. But to reiterate, as a shopping centre it's now quite good, as a functioning railway station less so
@AdamLBrown3
@railandroad
@undertheraedar
@poggs
Here a cut of the ORR 2021/22 data for the individual stations Cambridge (CBG) and King's Cross (KGX). With an exaggerated linear scale using `matplotlib` hence the slightly messy lines
The other graphs were combined and rendered in `QGIS`
Re-post alert: For those interested in such things let’s think about how to make an East Coast Main Line digital with European Train Control System (ETCS)
* Mostly because
@poggs
** told me "This a really cool video"
** which made me happy
#LeedDigi22
@Pixelfish
@crstry
"[Miss Dearheart] ‘I used to work in a bank in Sto Lat. The Cabbage Growers’ Co-operative’
‘Oh, the one on the town square? With the carved cabbage over the door?’ said Moist, before he could stop himself.
‘You know it?’ she said.
‘Well, yes. I went past it once...'"
For those interested in such things I give you European Rail Traffic Management System (ERTMS), ETCS, lights-on-sticks, in-cab signalling, ATO, Driver Advisory Systems all with an East Coast Main Line upgrade spin
#LeedsDigi22
@kooky_uk
@crstry
@b0rk
20 year's ago for a rebrand for a large UK website we needed a DNS change. We reduce the TTL, tested and went live to discover an interesting Windows server feature where MS "interpreted" the DNS RFC in a uniquely way where the cache would only refresh on reboot 1/2
For those interested in such things, here is a visualisation of
@openstreetmap
rail electrification data, and an overlay on centre-line track-model , with the
#FizzyKnitting
colour scheme
Scripts and data are here
#rail
#DataViz
Putting the passenger first
#raildigital2020
Is train maintenance a major cause of train failure?
Or is it issues with train consist and fleet dispatch at depot?
So, do passengers care about how much it costs to maintain stock?
@therailalliance
@BCCRE
@digi_rail
@GarethDennis
There would appear many people in coaches on a hard-shoulder on a motorway in Kent who may be currently reappraising their transportation choices. Albeit in an inexplicable way.
@GarethDennis
As someone who spent a chunk of my life on the Heart-of-Wales line which is arguably the most rural in Britain[*], I never saw a Pacer or on the rural Scarborough-Beverley
Rather it was semi-urban York-Harrogate-Leeds, or West-Yorkshire bus-on-rails
[*] top-five at least
@LUCYLucyprior
Good question and one I will answer after I have had my tea. Having just back home from Manchester, talking rail data for service recovery for the SE and data needed to modelthe rail network in the North to achieve zero-carbon by 2050
Unbidden advice for successful project delivery:
Start with a plan
Stick to the plan until you have executed the plan
Or the plan has failed
If the plan fails, stop and come up with a new plan
But stop
Repeat from the top
1/2
My fringe
#SheffDigiFest
talk on the 9 May 2022 is intended to provide a general albeit nerd adjacent audience with an overview of the current rail-freight timetable and processes
Details here
Free tickets are on Eventbrite and will be virtual on Teams
@AdamLBrown3
@lorenzo_hermoso
@undertheraedar
I have never made any statements about accuracy, that is your projection.
Rather this shows passenger flow where some places it will be better than others.
The caveats are in plain sight.
Please build a better model with the data at hand, as I would be very happy to see that.
@SimonZev
@GarethDennis
@Captain_Deltic
@RMTunion
@MarkMiddleton37
Thanks. As I was about to log on and check the latest numbers
Revenue figures have continued to increase since at least Christmas. Despite the TPE meltdown, Avanti and Northern issues and ongoing industrial disputes. Passenger number more so