List crawler visits

Individual crawler hits, newest first. One row per fetch: when, which bot, which path.

This is the only endpoint on the surface that uses cursor pagination, because it is the only feed where rows arrive continuously while you are walking it. An offset would skip or repeat rows as new visits land mid-walk.


GET /v1/brands/{brand_id}/crawler/logs

Authorization

Header	Type	Required
`Authorization`	`Bearer asky_sk_…`	required

Path parameters

Parameter	Type	Required	Description
`brand_id`	`uuid`	required	From List brands

Query parameters

Parameter	Type	Required	Description
`limit`	`integer`	optional	Rows per page, 1 to 100. Defaults to 20.
`cursor`	`string`	optional	Opaque cursor from the previous response. Treat it as a token, never construct one.
`start_date`	`YYYY-MM-DD`	optional	Inclusive lower bound, YYYY-MM-DD in UTC. Narrows the population before metrics are computed.
`end_date`	`YYYY-MM-DD`	optional	Inclusive upper bound, YYYY-MM-DD in UTC. Narrows the population before metrics are computed.
`bot_category`	`string`, repeatable	optional	Restrict to these crawler categories.
`crawler`	`string`, repeatable	optional	Restrict to these named crawlers.

Request

cURL


curl --request GET \
  --url 'https://api.askylabs.com/v1/brands/242546de-4cee-4a7d-952e-f6aa60c63ef8/crawler/logs?limit=50' \
  --header 'Authorization: Bearer <api-key>'

Python


import requests
 
url = "https://api.askylabs.com/v1/brands/242546de-4cee-4a7d-952e-f6aa60c63ef8/crawler/logs?limit=50"
 
headers = {"Authorization": "Bearer <api-key>"}
 
response = requests.get(url, headers=headers)
 
print(response.text)

JavaScript


const options = {method: 'GET', headers: {Authorization: 'Bearer <api-key>'}};
 
fetch('https://api.askylabs.com/v1/brands/242546de-4cee-4a7d-952e-f6aa60c63ef8/crawler/logs?limit=50', options)
  .then(res => res.json())
  .then(res => console.log(res))
  .catch(err => console.error(err));

PHP


<?php
 
$curl = curl_init();
 
curl_setopt_array($curl, [
  CURLOPT_URL => "https://api.askylabs.com/v1/brands/242546de-4cee-4a7d-952e-f6aa60c63ef8/crawler/logs?limit=50",
  CURLOPT_RETURNTRANSFER => true,
  CURLOPT_CUSTOMREQUEST => "GET",
  CURLOPT_HTTPHEADER => [
    "Authorization: Bearer <api-key>"
  ],
]);
 
$response = curl_exec($curl);
$err = curl_error($curl);
 
curl_close($curl);
 
if ($err) {
  echo "cURL Error #:" . $err;
} else {
  echo $response;
}

Go


package main
 
import (
    "fmt"
    "net/http"
    "io"
)
 
func main() {
 
    url := "https://api.askylabs.com/v1/brands/242546de-4cee-4a7d-952e-f6aa60c63ef8/crawler/logs?limit=50"
 
    req, _ := http.NewRequest("GET", url, nil)
 
    req.Header.Add("Authorization", "Bearer <api-key>")
 
    res, _ := http.DefaultClient.Do(req)
 
    defer res.Body.Close()
    body, _ := io.ReadAll(res.Body)
 
    fmt.Println(string(body))
 
}

Ruby


require 'uri'
require 'net/http'
 
url = URI("https://api.askylabs.com/v1/brands/242546de-4cee-4a7d-952e-f6aa60c63ef8/crawler/logs?limit=50")
 
http = Net::HTTP.new(url.host, url.port)
http.use_ssl = true
 
request = Net::HTTP::Get.new(url)
request["Authorization"] = 'Bearer <api-key>'
 
response = http.request(request)
puts response.read_body

Response

200


{
  "data": [
    {
      "id": "0c9a4f21-77b3-4e5d-92aa-6b1e0d38f4c7",
      "ts": "2026-08-13T06:41:19.220Z",
      "bot_name": "GPTBot",
      "bot_category": "ChatGPT",
      "path": "/blog/ai-visibility-guide",
      "domain": "getasky.com"
    }
  ],
  "pagination": {
    "limit": 20,
    "has_more": true,
    "next_cursor": "eyJ2IjoxLCJvIjoyMCwibCI6MjB9"
  },
  "meta": {
    "period": {
      "start_date": "2026-08-06",
      "end_date": "2026-08-13"
    },
    "timezone": "UTC"
  },
  "request_id": "req_5e91c0f2734b48ad9a17"
}

401


{
  "error": {
    "code": "token_expired",
    "message": "This API key has expired. Roll it in Settings to get a replacement.",
    "request_id": "req_8f21c0aa47b1490d2e63"
  }
}

404


{
  "error": {
    "code": "not_found",
    "message": "Not found.",
    "request_id": "req_5b0e77d213a94f6a8ce1"
  }
}

429


{
  "error": {
    "code": "rate_limited",
    "message": "Too many requests. Retry after 24 seconds.",
    "request_id": "req_31c9ba7f0e5d4a118cc2"
  }
}

Response fields

Field	Type	Description
`data.period`	`object`	required
`data.timezone`	`string`	required. Always `UTC`
`data.visits`	`object[]`	required
`data.visits[].id`	`uuid`	required
`data.visits[].ts`	`timestamptz`	required. When the fetch happened
`data.visits[].bot_name`	`string \| null`	Exact crawler, for example `GPTBot`
`data.visits[].bot_category`	`string`	required. The operator bucket the bot rolls up to
`data.visits[].path`	`string \| null`
`data.visits[].domain`	`string \| null`
`data.next_cursor`	`string \| null`	`null` on the last page. Pass it back as `cursor` to continue
`request_id`	`string`	required. Also returned as the `x-request-id` header. Quote it when contacting support

Errors

Status	Code	When
400	`invalid_request`	A parameter is unknown or malformed. The message names it
401	`invalid_token`	The key is missing, malformed, or does not exist
401	`token_expired`	The key passed its expiry date
401	`token_revoked`	The key was revoked
404	`not_found`	The brand does not exist, or this key is not allowed to reach it. The two are deliberately indistinguishable
429	`rate_limited`	Over 300 requests per minute. See the `Retry-After` header

Notes

Stop when next_cursor is null, not when a page looks short. The cursor reflects whether a next page genuinely exists, so a full-looking final page still returns null.

Human traffic is excluded. These are bot visits only, and humans are the large majority of raw log rows, so a count here is never comparable to analytics pageviews.

IP addresses, user agents, referrers and query strings are recorded but not returned. They exist in the underlying log and are withheld from this endpoint because they are request-level personal data: an IP plus a timestamp plus a path is identifying, and this surface is built so that a leaked key cannot become a privacy incident. bot_name and bot_category carry the analytical content of the user agent without the rest of it.

The cursor encodes a (timestamp, id) tuple rather than a timestamp alone. A timestamp is not a total order, and paging on it dropped every row that shared a boundary second.