Skip to content
Projects
Groups
Snippets
Help
Loading...
Help
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Z
ZHOUXINGYU_project
Project
Project
Details
Activity
Releases
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Boards
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
zhou
ZHOUXINGYU_project
Commits
a283447e
Commit
a283447e
authored
Jan 19, 2020
by
sanlu
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
爬取结束后,直接调用crawl_data_run()即可
parent
6cc425dc
Changes
2
Expand all
Show whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
298 additions
and
0 deletions
+298
-0
API_ALL.py
API_ALL.py
+295
-0
main_merge.py
main_merge.py
+3
-0
No files found.
API_ALL.py
0 → 100644
View file @
a283447e
This diff is collapsed.
Click to expand it.
main_merge.py
View file @
a283447e
...
@@ -16,6 +16,7 @@ from lstm_predict import LSTMNER
...
@@ -16,6 +16,7 @@ from lstm_predict import LSTMNER
import
os
import
os
from
ZOL_Crawler
import
CRAWLER
from
ZOL_Crawler
import
CRAWLER
import
threading
import
threading
from
API_ALL
import
Get_new
,
check_and_match
exitFlag
=
0
exitFlag
=
0
...
@@ -998,6 +999,8 @@ class crawl_data_fetch():
...
@@ -998,6 +999,8 @@ class crawl_data_fetch():
return
False
return
False
def
crawl_data_run
():
def
crawl_data_run
():
Get_new
()
check_and_match
()
#张楷部分。
thread_JD
=
myThread_crawl
(
'JD'
)
thread_JD
=
myThread_crawl
(
'JD'
)
thread_GM
=
myThread_crawl
(
'GM'
)
thread_GM
=
myThread_crawl
(
'GM'
)
thread_SN
=
myThread_crawl
(
'SN'
)
thread_SN
=
myThread_crawl
(
'SN'
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment