Commit @aaf31daf1b9393e5753ff6f41450778ce63d1f0f - yjyoon/구미시-네이버-블로그-스크레퍼

Y
List All
Feedback
- This Project
- All Projects

윤영준 2023-12-12

fixed a critical bug where title is not properlly gathered.

@aaf31daf1b9393e5753ff6f41450778ce63d1f0f

93fca0a

aaf31da

naver_blog_info_gatherer.py

--- naver_blog_info_gatherer.py

+++ naver_blog_info_gatherer.py


         orderBy = "sim"
     else:
         orderBy = "recentdate"
-    url = f"https://section.blog.naver.com/Search/Post.naver?pageNo={page_num}&orderBy={orderBy}&startDate={start_date}&endDate={end_date}&keyword={keyword}"
+    url = f"https://section.blog.naver.com/Search/Post.naver?pageNo={page_num}&rangeType=PERIOD&orderBy={orderBy}&startDate={start_date}&endDate={end_date}&keyword={keyword}"
     return url
 
 

 
 if __name__ == "__main__":
     #TODO start_page_num must be not working as intended
-    naver_blog_scrapper("도개면", "2022-01-01", "2023-10-31", 100, 50, 1, 12)
+    naver_blog_scrapper("도개면", "2022-10-28", "2023-10-31", 100, 50, 1, 12)

Add a comment

Open 0
Closed 0

List

...	...	@@ -47,7 +47,7 @@
47	47	orderBy = "sim"
48	48	else:
49	49	orderBy = "recentdate"
50		- url = f"https://section.blog.naver.com/Search/Post.naver?pageNo={page_num}&orderBy={orderBy}&startDate={start_date}&endDate={end_date}&keyword={keyword}"
	50	+ url = f"https://section.blog.naver.com/Search/Post.naver?pageNo={page_num}&rangeType=PERIOD&orderBy={orderBy}&startDate={start_date}&endDate={end_date}&keyword={keyword}"
51	51	return url
52	52
53	53
...	...	@@ -236,4 +236,4 @@
236	236
237	237	if __name__ == "__main__":
238	238	#TODO start_page_num must be not working as intended
239		- naver_blog_scrapper("도개면", "2022-01-01", "2023-10-31", 100, 50, 1, 12) (파일 끝에 줄바꿈 문자 없음)
	239	+ naver_blog_scrapper("도개면", "2022-10-28", "2023-10-31", 100, 50, 1, 12) (파일 끝에 줄바꿈 문자 없음)

Delete comment