Skip to content
Projects
Groups
Snippets
Help
Loading...
Help
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Z
ZHOUXINGYU_project
Project
Project
Details
Activity
Releases
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Boards
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
zhou
ZHOUXINGYU_project
Commits
4f6727db
Commit
4f6727db
authored
Mar 18, 2020
by
zhou
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
Update readme.md
parent
bcdfdf70
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
2 deletions
+2
-2
readme.md
readme.md
+2
-2
No files found.
readme.md
View file @
4f6727db
...
...
@@ -48,7 +48,7 @@
```
python
crawl_data_run
()
```
#### 其中,因为多线程调用NER模型同时载入多个类时,会出现一些错误,所以暂时禁用了多线程,在实例化后依次运行各渠道爬取数据。目前的代码如下:
####
3.
其中,因为多线程调用NER模型同时载入多个类时,会出现一些错误,所以暂时禁用了多线程,在实例化后依次运行各渠道爬取数据。目前的代码如下:
```
python
def
crawl_data_run
():
os
.
chdir
(
r'/root/program/newProductCheck/online_progrom/code/API_data'
)
...
...
@@ -59,7 +59,7 @@
thread_SN
=
myThread_crawl
(
'SN'
)
thread_OTHERS
=
myThread_crawl
(
'OTHERS'
)
```
#### 在mythread_crawl()类中,输入渠道名即可运行,其流程与api数据接收模块一致,并且直接在其后接上param_extract_function_crawl(),其和上边的param_extract_function()方法类似,但是产品子类编码和品牌编码直接继承了api接口来源数据的原始值。代码如下:
####
4.
在mythread_crawl()类中,输入渠道名即可运行,其流程与api数据接收模块一致,并且直接在其后接上param_extract_function_crawl(),其和上边的param_extract_function()方法类似,但是产品子类编码和品牌编码直接继承了api接口来源数据的原始值。代码如下:
```
python
class
myThread_crawl
():
def
__init__
(
self
,
channel
):
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment