作为国内最大的电商平台之一,京东数据采集具有多个维度。
有人需要采集商品信息,包括品类、品牌、产品名、价格、销量等字段,以了解商品销售状况、热门商品属性,进行市场扩大和重要决策;
有人需要采集产品评论,以明确产品优缺点、市场意向,进行新商品调研优化;
除了以上之外,还有很多的应用场景等待挖掘。下面为大家详细介绍京东数据采集的方法。
京东数据采集的方法
既然京东数据采集极为需要势在必行,那么该如何进行操作呢?是找到要采集的京东网址,将数据一条条复制粘贴到excel表格中?还是找一个爬虫工程师,写爬虫程序进行采集?
于普通人而言,这两种方法成本极高,效率低下——第一种耗费大量人力,还可能有多次出错;第二种成本很高且需要较长的学习时间,短时间内难以完成。有没有一种普通人都能简单采集京东的方法呢?
以下是我们整理的几个京东数据采集教程,大家可以按图文描述来操作即可,字段提取可根据自己的实际需求增减。
一、京东商品信息采集
采集内容:京东搜索关键词后,出现的商品列表信息采集
采集字段:商品标题,商品链接,商品价格,商品图片链接,商品评价数量,商品店铺名称,商品店铺链接
打开京东商品详情页(实例网址:https://item.jd.com/100194464870.html#switch-sku ),采集点击不同的参数(颜色、版本等)后得到的数据(商品编号、价格、主图链接等字段会随着参数变化而变化)。
有人需要采集商品信息,包括品类、品牌、产品名、价格、销量等字段,以了解商品销售状况、热门商品属性,进行市场扩大和重要决策;
有人需要采集产品评论,以明确产品优缺点、市场意向,进行新商品调研优化;
除了以上之外,还有很多的应用场景等待挖掘。下面为大家详细介绍京东数据采集的方法。
采集字段
商品标题、颜色、版本、价格、商品名称、商品编号、图片网址等。
封装JD.item_get-获得京东商品详情数据接口代码展示
1.请求方式:HTTP GET POST 请求链接:http://c0b.cc
2.请求代码示例,支持高并发请求(CURL、PHP 、PHPsdk 、Java 、C# 、Python...)
# coding:utf-8
"""
Compatible for python2.x and python3.x
requirement: pip install requests
"""
from __future__ import print_function
import requests
# 请求示例 url 默认请求参数已经做URL编码
url = "https://api-gw.服务器.cn/jd/item_get/?key=<您自己的apiKey>&secret=<您自己的apiSecret>&num_iid=10057467958584"
headers = {
"Accept-Encoding": "gzip",
"Connection": "close"
}
if __name__ == "__main__":
r = requests.get(url, headers=headers)
json_obj = r.json()
print(json_obj)
3.响应示例因文章字符限制,暂不展示全部
{
"item": {
"num_iid": "10057467958584",
"title": "卡富亚(KAAFUUYAA)145矮小个子50岁穿的连衣裙中年洋气质裙子40一五十雪纺夏装高贵花色L106-115斤",
"desc_short": "",
"price": "716.00",
"total_price": "",
"suggestive_price": "",
"orginal_price": "716.00",
"nick": "卡富亚伙腾专卖店",
"num": 33,
"min_num": 0,
"detail_url": "https://item.jd.com/10057467958584.html#crumb-wrap",
"pic_url": "//img13.360buyimg.com/n12/jfs/t1/125462/28/28387/257349/62e60e0bEddd31475/41ed23e1642bd846.jpg",
"brand": "卡富亚(KAAFUUYAA)",
"brandId": "772852",
"rootCatId": "1315",
"cid": "9719",
"desc": "",
"desc_img": "",
"item_imgs": [
{
"url": "//img10.360buyimg.com/n1/jfs/t1/125462/28/28387/257349/62e60e0bEddd31475/41ed23e1642bd846.jpg"
},
{
"url": "//img10.360buyimg.com/n1/jfs/t1/52879/29/20075/122800/62e60e0fEa5d19542/478cb7ab9b27d650.jpg"
},
{
"url": "//img10.360buyimg.com/n1/jfs/t1/21965/27/18805/132946/62e60e0bEf552fad1/9df7c593ec99f7cc.jpg"
}
],
"item_weight": null,
"location": null,
"post_fee": "",
"express_fee": "",
"ems_fee": "",
"video_id": "",
"is_promotion": "",
"props_name": "0:0:尺码:S85-95斤;0:1:尺码:M96-105斤;0:2:尺码:L106-115斤;0:3:尺码:XL116-125斤;0:4:尺码:2XL126-140斤;0:5:尺码:3XL141-150斤;1:0:颜色:花色;",
"prop_imgs": {
"prop_img": [
{
"properties": "1:0",
"url": "//img10.360buyimg.com/n1/jfs/t1/125462/28/28387/257349/62e60e0bEddd31475/41ed23e1642bd846.jpg"
}
]
},
"property_alias": "0:0:尺码:S85-95斤;0:1:尺码:M96-105斤;0:2:尺码:L106-115斤;0:3:尺码:XL116-125斤;0:4:尺码:2XL126-140斤;0:5:尺码:3XL141-150斤;1:0:颜色:花色;1:0:花色;",
"props": [],
"total_sold": "0",
"skus": {
"sku": [
{
"price": "716.00",
"orginal_price": "716.00",
"properties": "0:3;1:0",
"properties_name": "0:3:尺码:XL116-125斤;1:0:颜色:花色",
"quantity": "99",
"sku_id": "10057467958585",
"sku_url": "http://item.jd.com/10057467958585.html"
},
{
"price": "716.00",
"orginal_price": "716.00",
"properties": "0:4;1:0",
"properties_name": "0:4:尺码:2XL126-140斤;1:0:颜色:花色",
"quantity": "99",
"sku_id": "10057467958586",
"sku_url": "http://item.jd.com/10057467958586.html"
},
{
"price": "716.00",
"orginal_price": "716.00",
"properties": "0:5;1:0",
"properties_name": "0:5:尺码:3XL141-150斤;1:0:颜色:花色",
"quantity": "99",
"sku_id": "10076212308845",
"sku_url": "http://item.jd.com/10076212308845.html"
},
{
"price": "716.00",
"orginal_price": "716.00",
"properties": "0:1;1:0",
"properties_name": "0:1:尺码:M96-105斤;1:0:颜色:花色",
"quantity": "99",
"sku_id": "10057467958583",
"sku_url": "http://item.jd.com/10057467958583.html"
},
{
"price": "716.00",
"orginal_price": "716.00",
"properties": "0:2;1:0",
"properties_name": "0:2:尺码:L106-115斤;1:0:颜色:花色",
"quantity": "99",
"sku_id": "10057467958584",
"sku_url": "http://item.jd.com/10057467958584.html"
},
{
"price": "716.00",
"orginal_price": "716.00",
"properties": "0:0;1:0",
"properties_name": "0:0:尺码:S85-95斤;1:0:颜色:花色",
"quantity": "99",
"sku_id": "10057467958582",
"sku_url": "http://item.jd.com/10057467958582.html"
}
]
},
"seller_id": "12249469",
"sales": "0",
"shop_id": "12249469",
"props_list": {
"0:0": "尺码:S85-95斤",
"0:1": "尺码:M96-105斤",
"0:2": "尺码:L106-115斤",
"0:3": "尺码:XL116-125斤",
"0:4": "尺码:2XL126-140斤",
"0:5": "尺码:3XL141-150斤",
"1:0": "颜色:花色"
},
"seller_info": {
"shop_id": 12249469,
"zhuy": "http://mall.jd.com/index-12249469.html",
"nick": "卡富亚伙腾专卖店",
"shop_name": "卡富亚伙腾专卖店"
},
"props_img": {
"1:0": "//img10.360buyimg.com/n1/jfs/t1/125462/28/28387/257349/62e60e0bEddd31475/41ed23e1642bd846.jpg"
},
"_ddf": "fb",
"shop_item": [],
"relate_items": []
},
"secache": "340a7f4c54b449d2113b66e32edb6ae1",
"secache_time": 1752203430,
"secache_date": "2025-07-11 11:10:30",
"translate_status": "",
"translate_time": 0,
"language": {
"default_lang": "cn",
"current_lang": "cn"
},
"error": "",
"reason": "",
"error_code": "0000",
"cache": 0,
"api_info": "today:26 max:10000 all[227=26+41+160];expires:2030-10-30",
"execution_time": "2.478",
"server_time": "Beijing/2025-07-11 11:10:30",
"client_ip": "106.6.44.252",
"call_args": [
"10057467958584",
"jd"
],
"api_type": "jd",
"translate_language": "zh-CN",
"translate_engine": "baidu",
"server_memory": "3.41MB",
"request_id": "gw-1.687080a3a609e",
"last_id": "delay"
}
有人需要采集产品评论,以明确产品优缺点、市场意向,进行新商品调研优化!!!