Feature : docker proxy 추가 - #20

Open

seoyeong200 wants to merge 24 commits into

brickstudy:mainfrom

seoyeong200:main

Commits on Aug 29, 2024

fix : dockeroperator bug by adding proxy
seoyeong200
committed
8aa41b8

Commits on Sep 3, 2024

feature : get_soup 유틸쪽으로 이동
seoyeong200
committed
89233f2
fix : readme
seoyeong200
committed
fb0f20c
fix : bug- typo
seoyeong200
committed
b763d17
ADD : 인스타그램 url 수집 모듈 추가
seoyeong200
committed
aba1054
fix : close driver after url method returned
seoyeong200
committed
94e2d0d
add : materialize method in inscrawler
seoyeong200
committed
f299ae2
add : generate uid based on current datetime
seoyeong200
committed
9ea3206
add : crawling post data based on url(tested)
seoyeong200
committed
639e49f
delete : browser class
seoyeong200
committed
ddeeb45
fix : inscralwer 생성자 dev, prod 분리
seoyeong200
committed
87248de
add : 정해진 카테고리에 해당되는 브랜드명만 추출하는 모듈
seoyeong200
committed
0ab1ba2
ADD : instagram crawling dag
seoyeong200
committed
a66b2c5

Commits on Sep 4, 2024

fix : instagram 모듈 생성자에서 받는 arg 수정
seoyeong200
committed
932b294
fix : instagram dag 브랜드리스트 받는 부분 task 분리
seoyeong200
committed
f7a56ea

Commits on Sep 5, 2024

ADD : 임시 크롤러 스크립트
seoyeong200
committed
405b7e4
fix : 임시 태스크 버그 수정
seoyeong200
committed
42ef085
fix : refactor temporal task
seoyeong200
committed
4844003
fix : s3 path
seoyeong200
committed
6f6da8b

Commits on Sep 8, 2024

fix : crawler avoid account blocked
seoyeong200
committed
09ffaf4
fix : crawler - sleep 조정, 스크롤다운 추가
seoyeong200
committed
5ba7f38

Commits on Sep 28, 2024

add : humanize feature
seoyeong200
committed
c62a82c
add : catch suspicious account popup
seoyeong200
committed
0147d9a
fix : dummy
seoyeong200
committed
6e1666f