Skip to content
Projects
Groups
Snippets
Help
Loading...
Help
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
中
中电中采
Project
Project
Details
Activity
Releases
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Boards
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
ZGC_INDEX
中电中采
Commits
19307172
Commit
19307172
authored
Jan 18, 2021
by
rico.liu
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
update
parent
ea2e97cd
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
4 additions
and
4 deletions
+4
-4
main.py
模板建库/main.py
+4
-4
No files found.
模板建库/main.py
View file @
19307172
...
@@ -392,12 +392,12 @@ def GetParamsinfoAndPic(df):
...
@@ -392,12 +392,12 @@ def GetParamsinfoAndPic(df):
res
=
eval
(
response
.
text
)
res
=
eval
(
response
.
text
)
#处理未爬取到的数据
#处理未爬取到的数据
for
element
in
res
:
for
i
in
range
(
len
(
res
))
:
if
element
:
if
res
[
i
]
:
pass
pass
else
:
else
:
res
.
remove
(
element
)
res
[
i
]
=
{
'img_list'
:[],
'class_list'
:{},
'url'
:
''
}
res
.
append
({
'img_list'
:[],
'class_list'
:{},
'url'
:
''
})
df
[
'url_pic'
]
=
[
str
(
element
[
'img_list'
])
for
element
in
res
]
df
[
'url_pic'
]
=
[
str
(
element
[
'img_list'
])
for
element
in
res
]
crawl_params_list
=
[
str
(
element
[
'class_list'
])
.
replace
(
"'': ''"
,
""
)
.
replace
(
", ,"
,
","
)
.
replace
(
"{,"
,
"{"
)
.
replace
(
" "
,
""
)
for
element
in
res
]
crawl_params_list
=
[
str
(
element
[
'class_list'
])
.
replace
(
"'': ''"
,
""
)
.
replace
(
", ,"
,
","
)
.
replace
(
"{,"
,
"{"
)
.
replace
(
" "
,
""
)
for
element
in
res
]
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment