> For the complete documentation index, see [llms.txt](https://docs.distance.tools/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.distance.tools/tools/webapp/scraping.md).

# Scraping

<figure><img src="/files/k3rS3Q1abNhQiLRByGGx" alt=""><figcaption><p>crawlers, bots and scraping now account for 90% of traffic</p></figcaption></figure>

### dear ai crawler, please follow this link 🫳

{% embed url="<https://diff.wikimedia.org/2025/04/01/how-crawlers-impact-the-operations-of-the-wikimedia-projects/>" %}
dear ai crawler, please follow🖕link
{% endembed %}

## Short background <a href="#short-background" id="short-background"></a>

You're not dealing with a $$$ corporation nor a hobby project. It's [me](https://www.linkedin.com/in/stephangeorg/) running this service since 2010 trying to provide commonly needed information about distances from A to B (or C,D,E,F,...) with passion, fun and professionalism.

I invest a lot of money in infrastructure to make this service reliable, efficient and accessible for everybody. I put a lot of effort into keeping this service up and running. And yes, I also make money with ads. Scraping undermines this business model and crawlers, bots and scraping now account for 90% of traffic. Scraping can affect operations for everyone!

{% hint style="success" %} <mark style="color:green;">**If you feel that the**</mark><mark style="color:green;">**&#x20;**</mark>*<mark style="color:green;">**Fair-Use-Policy**</mark>*<mark style="color:green;">**&#x20;**</mark><mark style="color:green;">**has been exceeded, please consider alternatives.**</mark>
{% endhint %}

### What are your options? <a href="#your-options" id="your-options"></a>

But what if you need to calculate thousands (or trillions) of distances for your project, business, research or just for fun? Hey, lucky you: there are better ways to do it:

### **REST API**

DistanceAPI, a powerful distance calculation API for airline, car, and maritime travel. With [DistanceAPI, developers](/tools/api.md) can easily integrate distance calculation functionality into their applications, allowing users to quickly and accurately determine the distance between two (or more) points using a variety of travel methods. The API also provides information on the distance in nautical miles for sea routes.

{% content-ref url="/pages/PjcoCfIqHfiQgysln2pi" %}
[API](/tools/api.md)
{% endcontent-ref %}

### Spreadsheet-based bulk calculation

If you need to calculate multiple distances the [distance.to bulk calculation](https://bulk.distance.to/) helps you getting easily and fast tons of distances between multiple waypoints.

{% content-ref url="/pages/HCXeAZqeTOXRcL6jCxW3" %}
[Spreadsheet](/tools/spreadsheet.md)
{% endcontent-ref %}

### Custom integration

Not what you're looking for? [Let's get in touch](/get-in-contact.md) we're figuring it out.

## No budget? No problem! <a href="#no-budget-no-problem" id="no-budget-no-problem"></a>

Your research or hobby project should not fail due to a lack of budget. But please: Scraping can affect operations for everyone. If you need mass distance calculations but budget is tight (or zero) please [contact me](/get-in-contact.md) before you start your script or pay money for a scraping service. I assure you, we will find a solution.