Metadata-Version: 2.1
Name: shopee_crawler
Version: 0.2.1
Summary: Crawler for Shopee from all country
Home-page: https://github.com/lthoangg/shopee-crawler
Author: Lê Trọng Hoàng
Author-email: letronghoang00@gmail.com
License: UNKNOWN
Platform: UNKNOWN
Classifier: Programming Language :: Python :: 3
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: OS Independent
Requires-Python: >=3.7
Description-Content-Type: text/markdown
License-File: LICENSE

# Shopee-crawler

This is a light crawling tool.

High performance.

Easy to use.
***
## Requirement
```env
python>=3.7
```

## Install

* Using `setup.py`
```
git clone https://github.com/lthoangg/shopee-crawler
python/python3 setup.py install
```

* Using `pip`
```
pip install shopee-crawler
```

## How to use
Examples:
```python
from shopee_crawler import Crawler

crawler = Crawler()
crawler.set_origin(origin="shopee.vn") # Input your root Shopee website of your country that you want to crawl

data = crawler.crawl_by_shop_url(shop_url='shop_url')

data = crawler.crawl_by_cat_url(cat_url='cat_url')

data = crawler.crawl_by_search(keyword='keyword')

data = crawler.crawl_cat_list()
# print(data)
```

## Usage
- About 12.000 rows (products) in 2-3 seconds (32 workers)

- About 12.000 rows (products) in 5-6 seconds (16 workers)

## Test yourself

```python
import time
from shopee_crawler import Crawler

crawler = Crawler()
crawler.set_origin(origin="shopee.vn")

keyword = 'điện thoại samsung'

# Start time
start = time.time()

# Crawl
data = crawler.crawl_by_search(keyword=keyword)

# End time
end = time.time()

# Time crawling
print("Time : ",end - start, "seconds")

```

