Feature request: Using IPinfo Lite DB

[abdullahdevrel]

I am requesting to add support for IPinfo's Lite to the project. The database has the following features:

• It is updated daily, with zero compromise to accuracy. There is no range clustering, and the database provides full accuracy.
• It includes country and ASN information in the same database.
• The data granularity reaches individual IP level.
• It is licensed under CC-BY-SA 4.0, permitting commercial usage, redistribution, and repackaging.
• Available file formats include: CSV, MMDB, JSON and Parquet
• The data is tabular and unnested, making it very easy to use. The dataset includes both IPv4 and IPv6 in a single file.

Database schema

Field Name	Example	Data Type	Descrption
network	154.24.39.204/30	TEXT	CIDR/IP range or single IP address
country	Canada	TEXT	Country name
country_code	CA	TEXT	Two-letter ISO 3166 country code of the IP addresses
continent	North America	TEXT	Continent name of the IP location
continent_code	NA	TEXT	Two-letter continent code of the IP location
asn	AS174	TEXT	Autonomous System Number, an organization that owns the IP range block
as_name	Cogent Communications	TEXT	Name of the AS (Autonomous System Number) organization
as_domain	cogentco.com	TEXT	Official domain or website of the ASN organization

Documentation: https://ipinfo.io/developers/ipinfo-lite-database

Samples: https://github.com/ipinfo/sample-database/tree/main/IPinfo%20Lite

The IP database can be simply downloaded with only an free access token:

curl -L https://ipinfo.io/data/ipinfo_lite.csv.gz?token=$TOKEN -o ipinfo_lite.csv.gz

We also have a free IPinfo Lite API service based on this database that supports unlimited requests. Let me know what you think. Thanks!

[szuecs]

Sounds Like a good idea for predicates and filters to have it.
The apikey is static or requires updates?

[abdullahdevrel]

@szuecs It is completely static. You can even share the API key.

In fact, we recommend that projects share their project-specific API key in the codebase so users can download the data themselves.

[szuecs]

@abdullahdevrel ok thanks we can provide a env variable passing of the API Key (we call static tokens rather API Key, then token to have a clear naming on the difference of rotated tokens and static keys).

[abdullahdevrel]

Awesome. Please do reach out to me if you have any questions about the data. It is fantastic data, and a ton of awesome open source projects have adopted it already.

[szuecs]

reference to prior work https://github.com/skipper-plugins/filters/blob/master/geoip/geoip.go

I think we should create a package withing ./net, that has a GeoLookupRegistry{} that downloads at startup and once a day the IPinfo database to have it fresh. The data provided there should be used in new predicates or filters that work on this data.

A predicate could be used to support geo local routes, that allow more or less traffic based on geo information and cluster ratelimits for example.