Traveller Store CotI Features New Posts Mark Forums Read Register


Go Back TravellerRPG.com > Citizens of the Imperium > General Traveller Discussions > Software Solutions

Software Solutions Discussions on Traveller related software.

Reply
 
Thread Tools Display Modes
  #1  
Old December 25th, 2020, 03:23 PM
Tiikeri Tiikeri is offline
Citizen: SOC-12
 
Join Date: Jul 2013
Posts: 270
Gallery : 0
Tiikeri Citizen
Default How can I extract data from the Traveller Map for a spreadsheet

How can I extract data from the Traveller Map (www.travellermap.com) for use in a spreadsheet?

I want to make a spreadsheet that I can sort to determine the type and number of starports in a subsector and things like that.

Thanks.
Reply With Quote
  #2  
Old December 25th, 2020, 03:33 PM
AnotherDilbert AnotherDilbert is offline
Citizen: SOC-14
 
Join Date: May 2008
Location: Stockholm 🇸🇪
Posts: 2,437
Gallery : 0
AnotherDilbert Citizen+AnotherDilbert Citizen+AnotherDilbert Citizen+
Default

Look here:
https://travellermap.com/doc/api

E.g.:
https://travellermap.com/data/SPIN
Gives you the data for the Spinward Marches.
Reply With Quote
  #3  
Old December 26th, 2020, 04:30 AM
ShawnDriscoll's Avatar
ShawnDriscoll ShawnDriscoll is offline
Citizen: SOC-13
 
Join Date: Apr 2017
Posts: 933
Gallery : 0
ShawnDriscoll Citizen+ShawnDriscoll Citizen+
Default

One way is to write a program that converts the imported map data into a CSV file. That's how I did it. Heck, the travellermap site might already do that for you these days.
Reply With Quote
  #4  
Old December 26th, 2020, 07:13 AM
tjoneslo tjoneslo is offline
Citizen: SOC-14
 
Join Date: Feb 2001
Location: Ferrisburgh, VT, USA
Posts: 2,967
Gallery : 2
Visit tjoneslo's Blog
tjoneslo Citizen+tjoneslo Citizen+tjoneslo Citizen+
Default

If you use the API, you can get it to dump the data out in a tab separated file (TSV), which you can very easily parsed by the spreadsheet.

The challenge with a comma separated file (CSV) is this is a poorly defined format and is easy to break in unexpected way. Especially given the names used for the Traveller worlds.

I know at least one person downloaded all the Traveller Map data and loaded it into a SQL database. I keep thinking I want to do the same thing, but not gotten around to it.
__________________
Archduke of the Solomani Rim - Terra (Solomani Rim 1827)
Duke Akumid - Akumid (Vland 1628)
Marquis Yeremyh - Yeremyh (Solomani Rim 1804)
Marquis Hysyl - Hysyl (Deneb 2425)
Baron Regina - Regina (Spinward Marches 1910)
TAS member - Vipan (Empty Quarter 1038)
Be part of the history of Traveller:

https://wiki.travellerrpg.com/Main_Page
Reply With Quote
  #5  
Old December 26th, 2020, 07:46 AM
AnotherDilbert AnotherDilbert is offline
Citizen: SOC-14
 
Join Date: May 2008
Location: Stockholm 🇸🇪
Posts: 2,437
Gallery : 0
AnotherDilbert Citizen+AnotherDilbert Citizen+AnotherDilbert Citizen+
Default

Quite, tab separated is probably easier and e.g. Excel should import it without problem:

https://travellermap.com/data/SPIN/tab

Replace SPIN with desired sector name, e.g.:

https://travellermap.com/data/DENEB/tab
Reply With Quote
  #6  
Old December 26th, 2020, 10:37 AM
whartung whartung is offline
Citizen: SOC-14
 
Join Date: Nov 2004
Posts: 2,854
Gallery : 0
whartung Citizen+whartung Citizen+whartung Citizen+
Default

Quote:
Originally Posted by tjoneslo View Post
The challenge with a comma separated file (CSV) is this is a poorly defined format and is easy to break in unexpected way.
No, it's a well defined format with many bad implementations.
Reply With Quote
  #7  
Old December 27th, 2020, 04:54 AM
ShawnDriscoll's Avatar
ShawnDriscoll ShawnDriscoll is offline
Citizen: SOC-13
 
Join Date: Apr 2017
Posts: 933
Gallery : 0
ShawnDriscoll Citizen+ShawnDriscoll Citizen+
Default

Quote:
Originally Posted by tjoneslo View Post
The challenge with a comma separated file (CSV) is this is a poorly defined format and is easy to break in unexpected way. Especially given the names used for the Traveller worlds.
Commas in string names have never been an issue for me. I have the sector map files loaded up into MongoDB in JSON format these days.
Reply With Quote
  #8  
Old December 27th, 2020, 04:22 PM
coliver988's Avatar
coliver988 coliver988 is online now
Baron
 
Join Date: Dec 2003
Location: Asheville
Posts: 1,749
Gallery : 110
Visit coliver988's Blog
coliver988 Citizen++coliver988 Citizen++coliver988 Citizen++coliver988 Citizen++
Default

Quote:
Originally Posted by tjoneslo View Post
If you use the API, you can get it to dump the data out in a tab separated file (TSV), which you can very easily parsed by the spreadsheet.

The challenge with a comma separated file (CSV) is this is a poorly defined format and is easy to break in unexpected way. Especially given the names used for the Traveller worlds.

I know at least one person downloaded all the Traveller Map data and loaded it into a SQL database. I keep thinking I want to do the same thing, but not gotten around to it.
Tabs are a bit safer than commas (parsing CSV files with text with commas is...interesting. At least HL7 uses the pipe / vertical bar for field separators, and those are a lot less likely to show up in text strings!). And at least one of my many incomplete Traveller trade programs accessed the TravellerMap and did suck the data for the current subsector into a SQLite DB. Theory was I cached it for existing sectors to minimize API calls. One of these days I'll probably finish the current version, or start all over again....the software world changes far too much in the last few years. Seems like every 2-5 years I am learning yet another framework to just do the same thing (this is my professional life: I know I can stick with whatever framework I want for my personal projects. )
__________________
Mostly lurking about...CT is still my favorite with T5 as a neat tool box to plunder.


Duke of The Solomani RimLANGELOS A4249A6-FLangelos Write Up Alpha
Baron, IpkurIpkur C564543-9Ipkur Write Up Alpha
Knight of the Third Imperium [x2]Rhylanor A434934-FIkuna E000410-A
MCG For Conspicuous GallantryThe Assault On Alellhttps://github.com/COliver988/Traveller
Travellers Aid Society 2798Dudid B510526-9http://traveller-ct.blogspot.com/
Reply With Quote
  #9  
Old December 28th, 2020, 12:20 AM
whartung whartung is offline
Citizen: SOC-14
 
Join Date: Nov 2004
Posts: 2,854
Gallery : 0
whartung Citizen+whartung Citizen+whartung Citizen+
Default

Quote:
Originally Posted by coliver988 View Post
Tabs are a bit safer than commas (parsing CSV files with text with commas is...interesting. At least HL7 uses the pipe / vertical bar for field separators, and those are a lot less likely to show up in text strings!).
CSV has quoting rules just for this problem. Commas are not the only issue with CSV.

HL7 separators are configurable per message, and also has an escape character (also configurable per message).
Reply With Quote
  #10  
Old December 29th, 2020, 11:12 AM
BRover's Avatar
BRover BRover is offline
Citizen: SOC-12
 
Join Date: Jan 2020
Posts: 394
Gallery : 0
BRover Citizen
Default

Quote:
Originally Posted by coliver988 View Post
. . .
One of these days I'll probably finish the current version, or start all over again....the software world changes far too much in the last few years. Seems like every 2-5 years I am learning yet another framework to just do the same thing (this is my professional life: I know I can stick with whatever framework I want for my personal projects. )
Yeah, I hear you. I know a periodical editor who (natch) has to keep up with the latest version of Word, because contributors will send articles in a variety of formats, and he's got to work with them as sent. He tends to complain that, back 30 years ago, a program lasted lots longer and was simpler: he could not only figure out all the functions, but use them enough to learn them pretty much automatically. Nowadays, the programs do lots more, but he barely has time to find all the functions, much less learn them (and forget about doing it automatically) before it gets replaced--and he's got to start all over.
__________________
There are three types of Travellers with Math-3+: those who can count, and those who cannot.

Our Traveller Universes clearly are at variance. Blessed be the variance!
Reply With Quote
Reply

Bookmarks

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Data formats for Traveller robject Software Solutions 0 November 25th, 2011 10:22 AM
UWP data spreadsheet question? rogermccarthy The Lone Star 27 January 27th, 2006 08:23 PM
All system data spreadsheet TheEngineer Software Solutions 25 November 14th, 2004 03:53 PM

This website and its contents are copyright ©2010- Far Future Enterprises. All rights reserved. Traveller is a registered trademark of Far Future Enterprises .
Powered by vBulletin® Version 3.8.4
Copyright ©2000 - 2021, Jelsoft Enterprises Ltd.
Copyright (c) 2010-2013, Far Future Enterprises. All Rights Reserved.