1. 帮助中心
  2. API 文档资源
  3. 数据采集器 API

接受批量数据

API endpoint: GET /dca/dataset?id={id_dataset}
Parameters :
  • id={id_dataset} – An unique identification of data set.
Payload :
  • Header: Authorization Bearer Key -H "Authorization: Bearer API_TOKEN"
Sample Response :
  • Waiting for dataset to be ready 
    {
    "status": "building",
    "message": "Dataset is not ready yet, try again in XXs"
}
  • Dataset is ready 
    [
    {
        "Image": "https://targetwebsite.com/product_id.png",
        "Title": "product_name",
        "Price": "product_price",
        "input": {
            "url": "https://targetwebsite.com/product_id/"
        }
    }
]
 
Shell
curl"https://api.brightdata.com/dca/dataset?id=ID_DATASET"-H "Content-Type: application/json" -H "Authorization: Bearer API_TOKEN"

Node.js

#!/usr/bin/env noderequire('request-promise')({
	url: 'https://api.brightdata.com/dca/dataset?id=ID_DATASET',
	headers: {'Content-Type': 'application/json','Authorization':'Bearer API_TOKEN'},
}).then(function(data){ console.log(data); },
	function(err){ console.error(err); });

Java

packageexample;

importorg.apache.http.HttpHost;
importorg.apache.http.client.fluent.*;

public classExample {
  public static voidmain(String[] args) throwsException {
    String res = Executor.newInstance()
      .addHeader("Content-Type", "application/json")
      .addHeader("Authorization", "Bearer API_TOKEN")
      .execute(Request.Get("https://api.brightdata.com/dca/dataset?id=ID_DATASET"))
      .returnContent().asString();
    System.out.println(res)
  }
}

C#

usingSystem;
usingSystem.Net;
usingSystem.Net.Http;
usingSystem.Net.Http.Headers;

public classProgram {
  public static asyncTaskMain() {
    var client = newHttpClient();
    var requestMessage = newHttpRequestMessage {
      Method = HttpMethod.Get,
      RequestUri = newUri("https://api.brightdata.com/dca/dataset?id=ID_DATASET"),
      Headers = {
        {"Content-Type", "application/json"},
        {"Authorization", "Bearer API_TOKEN"}
      }
    };
    var response = await client.SendAsync(requestMessage);
    var responseString = await response.Content.ReadAsStringAsync();
    Console.WriteLine(responseString);
  }
}

Python

#!/usr/bin/env python
print('If you get error "ImportError: No module named requests", please install it:\n$ sudo pip install requests');
import requests

headers = {'Content-Type': 'application/json','Authorization': 'Bearer API_TOKEN'}
r = requests.get('https://api.brightdata.com/dca/dataset?id=ID_DATASET', headers=headers)
print(r.content)

这篇文章有帮助吗？