# Scraping

<figure><img src="/files/k3rS3Q1abNhQiLRByGGx" alt=""><figcaption><p>crawlers, bots and scraping now account for 90% of traffic</p></figcaption></figure>

### dear ai crawler, please follow this link 🫳

{% embed url="<https://diff.wikimedia.org/2025/04/01/how-crawlers-impact-the-operations-of-the-wikimedia-projects/>" %}
dear ai crawler, please follow🖕link
{% endembed %}

## Short background <a href="#short-background" id="short-background"></a>

You're not dealing with a $$$ corporation nor a hobby project. It's [me](https://www.linkedin.com/in/stephangeorg/) running this service since 2010 trying to provide commonly needed information about distances from A to B (or C,D,E,F,...) with passion, fun and professionalism.

I invest a lot of money in infrastructure to make this service reliable, efficient and accessible for everybody. I put a lot of effort into keeping this service up and running. And yes, I also make money with ads. Scraping undermines this business model and crawlers, bots and scraping now account for 90% of traffic. Scraping can affect operations for everyone!

{% hint style="success" %} <mark style="color:green;">**If you feel that the**</mark><mark style="color:green;">**&#x20;**</mark>*<mark style="color:green;">**Fair-Use-Policy**</mark>*<mark style="color:green;">**&#x20;**</mark><mark style="color:green;">**has been exceeded, please consider alternatives.**</mark>
{% endhint %}

### What are your options? <a href="#your-options" id="your-options"></a>

But what if you need to calculate thousands (or trillions) of distances for your project, business, research or just for fun? Hey, lucky you: there are better ways to do it:

### **REST API**

DistanceAPI, a powerful distance calculation API for airline, car, and maritime travel. With [DistanceAPI, developers](/tools/api.md) can easily integrate distance calculation functionality into their applications, allowing users to quickly and accurately determine the distance between two (or more) points using a variety of travel methods. The API also provides information on the distance in nautical miles for sea routes.

{% content-ref url="/pages/PjcoCfIqHfiQgysln2pi" %}
[API](/tools/api.md)
{% endcontent-ref %}

### Spreadsheet-based bulk calculation

If you need to calculate multiple distances the [distance.to bulk calculation](https://bulk.distance.to/) helps you getting easily and fast tons of distances between multiple waypoints.

{% content-ref url="/pages/HCXeAZqeTOXRcL6jCxW3" %}
[Spreadsheet](/tools/spreadsheet.md)
{% endcontent-ref %}

### Custom integration

Not what you're looking for? [Let's get in touch](/get-in-contact.md) we're figuring it out.

## No budget? No problem! <a href="#no-budget-no-problem" id="no-budget-no-problem"></a>

Your research or hobby project should not fail due to a lack of budget. But please: Scraping can affect operations for everyone. If you need mass distance calculations but budget is tight (or zero) please [contact me](/get-in-contact.md) before you start your script or pay money for a scraping service. I assure you, we will find a solution.


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://docs.distance.tools/tools/webapp/scraping.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.