Instapy: Accepting cookie

Created on 7 Oct 2020  路  21Comments  路  Source: timgrossmann/InstaPy

There's this annoying popup that shows up now when connecting to instagram. Does anyone know where in login.py I should code the new browser.click() for accepting cookies?

picture itssmaxy
👍3

All 21 comments

@itssmaxy
i have the same problem even after updating the files .. here we talked about the problem

Timed out with failure while explicitly waiting until title contains 'Login' string! #5799

Subject: instagram_title_fix #5813

Polkyanik picture Polkyanik on 8 Oct 2020

Try to apply the fix and remove log folder but nothing change...

Booleboole picture Booleboole on 9 Oct 2020

Yes I have the same issue when I remove the cookies. When I delete the cookies, I need to accept the cookies policies from instagram again. So the solution is not remove the cookies but if you did, need to accept the cookies policies again.

Some fix for this? I already have changed the title for Instagram. This is not the problem anymore, for me at least.

jhrtrl picture jhrtrl on 9 Oct 2020

@elulcao 

Try to apply the fix and remove log folder but nothing change...

1602270018149   webdriver::server   DEBUG   <- 200 OK {"value":null}
1602270018152   webdriver::server   DEBUG   -> POST /session/2eeca74b-a3e4-4aae-8934-952921211dac/execute/sync {"script": "return window._sharedData.config.viewer", "args": []}
1602270018157   Marionette  DEBUG   0 -> [0,29,"WebDriver:ExecuteScript",{"args":[],"newSandbox":false,"script":"return window._sharedData.config.viewer","specialPowers":false}]
1602270018172   Marionette  DEBUG   0 <- [1,29,{"error":"javascript error","message":"TypeError: window._sharedData is undefined","stacktrace":"@https://www.instagram.com/:2:7\n@https://www.instagram.com/:3:8\n"},null]
1602270018173   webdriver::server   DEBUG   <- 500 Internal Server Error {"value":{"error":"javascript error","message":"TypeError: window._sharedData is undefined","stacktrace":"@https://www.instagram.com/:2:7\n@https://www.instagram.com/:3:8\n"}}
1602270018175   webdriver::server   DEBUG   -> POST /session/2eeca74b-a3e4-4aae-8934-952921211dac/element {"using": "xpath", "value": "//button[text()='Log In']"}
1602270018181   Marionette  DEBUG   0 -> [0,30,"WebDriver:FindElement",{"using":"xpath","value":"//button[text()='Log In']"}]
1602270024104   Marionette  DEBUG   0 <- [1,30,{"error":"no such element","message":"Unable to locate element: //button[text()='Log In']","stacktrace":"WebDriverError ... entError@chrome://marionette/content/error.js:387:5\nelement.find/</<@chrome://marionette/content/element.js:343:16\n"},null]
1602270024106   webdriver::server   DEBUG   <- 404 Not Found {"value":{"error":"no such element","message":"Unable to locate element: //button[text()='Log In']","stacktrace":"WebDriverError@chrome://marionette/content/error.js:175:5\nNoSuchElementError@chrome://marionette/content/error.js:387:5\nelement.find/</<@chrome://marionette/content/element.js:343:16\n"}}
1602270024109   webdriver::server   DEBUG   -> POST /session/2eeca74b-a3e4-4aae-8934-952921211dac/element {"using": "xpath", "value": "//a[text()='Log in']"}
1602270024111   Marionette  DEBUG   0 -> [0,31,"WebDriver:FindElement",{"using":"xpath","value":"//a[text()='Log in']"}]
1602270029211   Marionette  DEBUG   0 <- [1,31,{"error":"no such element","message":"Unable to locate element: //a[text()='Log in']","stacktrace":"WebDriverError@chro ... entError@chrome://marionette/content/error.js:387:5\nelement.find/</<@chrome://marionette/content/element.js:343:16\n"},null]
1602270029213   webdriver::server   DEBUG   <- 404 Not Found {"value":{"error":"no such element","message":"Unable to locate element: //a[text()='Log in']","stacktrace":"WebDriverError@chrome://marionette/content/error.js:175:5\nNoSuchElementError@chrome://marionette/content/error.js:387:5\nelement.find/</<@chrome://marionette/content/element.js:343:16\n"}}
1602270029216   webdriver::server   DEBUG   -> POST /session/2eeca74b-a3e4-4aae-8934-952921211dac/element {"using": "xpath", "value": "//div[text()='Log In']"}
1602270029219   Marionette  DEBUG   0 -> [0,32,"WebDriver:FindElement",{"using":"xpath","value":"//div[text()='Log In']"}]
1602270034236   Marionette  DEBUG   0 <- [1,32,{"error":"no such element","message":"Unable to locate element: //div[text()='Log In']","stacktrace":"WebDriverError@ch ... entError@chrome://marionette/content/error.js:387:5\nelement.find/</<@chrome://marionette/content/element.js:343:16\n"},null]
1602270034238   webdriver::server   DEBUG   <- 404 Not Found {"value":{"error":"no such element","message":"Unable to locate element: //div[text()='Log In']","stacktrace":"WebDriverError@chrome://marionette/content/error.js:175:5\nNoSuchElementError@chrome://marionette/content/error.js:387:5\nelement.find/</<@chrome://marionette/content/element.js:343:16\n"}}
1602270034243   webdriver::server   DEBUG   -> DELETE /session/2eeca74b-a3e4-4aae-8934-952921211dac/cookie 
1602270034246   Marionette  DEBUG   0 -> [0,33,"WebDriver:DeleteAllCookies",{}]
1602270034265   Marionette  DEBUG   0 <- [1,33,null,{"value":null}]
1602270034267   webdriver::server   DEBUG   <- 200 OK {"value":null}
1602270034271   webdriver::server   DEBUG   -> DELETE /session/2eeca74b-a3e4-4aae-8934-952921211dac 
1602270034274   Marionette  DEBUG   0 -> [0,34,"Marionette:Quit",{"flags":["eForceQuit"]}]
1602270034278   Marionette  INFO    Stopped listening on port 44323
1602270034569   Marionette  TRACE   Received observer notification quit-application
1602270034579   Marionette  DEBUG   0 <- [1,34,null,{"cause":"shutdown"}]
1602270034673   webdriver::server   DEBUG   Deleting session
1602270034704   Marionette  DEBUG   0 -> [0,35,"Marionette:Quit",{"flags":["eForceQuit"]}]
1602270034706   Marionette  DEBUG   0 <- [1,35,{"error":"invalid session id","message":"Tried to run command without establishing a connection","stacktrace":"WebDrive ... t@chrome://marionette/content/server.js:249:9\n_onJSONObjectReady/<@chrome://marionette/content/transport.js:503:20\n"},null]
1602270034725   Marionette  DEBUG   Closed connection 0
1602270036245   Marionette  TRACE   Received observer notification xpcom-will-shutdown
1602270036245   Marionette  DEBUG   Resetting recommended pref apz.content_response_timeout
1602270036246   Marionette  DEBUG   Resetting recommended pref browser.contentblocking.introCount
1602270036246   Marionette  DEBUG   Resetting recommended pref browser.download.panel.shown
1602270036246   Marionette  DEBUG   Resetting recommended pref browser.pagethumbnails.capturing_disabled
1602270036246   Marionette  DEBUG   Resetting recommended pref browser.tabs.disableBackgroundZombification
1602270036247   Marionette  DEBUG   Resetting recommended pref browser.tabs.remote.separatePrivilegedContentProcess
1602270036247   Marionette  DEBUG   Resetting recommended pref browser.tabs.unloadOnLowMemory
1602270036247   Marionette  DEBUG   Resetting recommended pref browser.tabs.warnOnCloseOtherTabs
1602270036247   Marionette  DEBUG   Resetting recommended pref browser.urlbar.suggest.searches
1602270036248   Marionette  DEBUG   Resetting recommended pref datareporting.policy.dataSubmissionPolicyAccepted
1602270036248   Marionette  DEBUG   Resetting recommended pref dom.disable_beforeunload
1602270036248   Marionette  DEBUG   Resetting recommended pref dom.file.createInChild
1602270036248   Marionette  DEBUG   Resetting recommended pref extensions.getAddons.cache.enabled
1602270036248   Marionette  DEBUG   Resetting recommended pref extensions.webservice.discoverURL
1602270036249   Marionette  DEBUG   Resetting recommended pref network.http.prompt-temp-redirect
1602270036249   Marionette  DEBUG   Resetting recommended pref network.http.speculative-parallel-limit
1602270036249   Marionette  DEBUG   Resetting recommended pref security.certerrors.mitm.priming.enabled
1602270036249   Marionette  DEBUG   Resetting recommended pref security.notification_enable_delay
1602270036249   Marionette  DEBUG   Resetting recommended pref signon.autofillForms
1602270036250   Marionette  DEBUG   Resetting recommended pref toolkit.cosmeticAnimations.enabled
1602270036251   Marionette  DEBUG   Remote service is inactive
1602270037113   geckodriver::marionette DEBUG   Browser process stopped: exit code: 0
1602270037156   webdriver::server   DEBUG   <- 200 OK {"value":null}
Polkyanik picture Polkyanik on 9 Oct 2020

1602270034271 webdriver::server DEBUG -> DELETE /session/2eeca74b-a3e4-4aae-8934-952921211dac
1602270034274 Marionette DEBUG 0 -> [0,34,"Marionette:Quit",{"flags":["eForceQuit"]}]
1602270034278 Marionette INFO Stopped listening on port 44323
1602270034569 Marionette TRACE Received observer notification quit-application
1602270034579 Marionette DEBUG 0 <- [1,34,null,{"cause":"shutdown"}]
1602270034673 webdriver::server DEBUG Deleting session
1602270034704 Marionette DEBUG 0 -> [0,35,"Marionette:Quit",{"flags":["eForceQuit"]}]
1602270034706 Marionette DEBUG 0 <- [1,35,{"error":"invalid session id","message":"Tried to run command without establishing a connection","stacktrace":"WebDrive ... t@chrome://marionette/content/server.js:249:9n_onJSONObjectReady/<@chrome://marionette/content/transport.js:503:20n"},null]
1602270034725 Marionette DEBUG Closed connection 0

HI @Polkyanik
Reviewed the trace provided but still looking for what could be the culprit of this issue, this time is not the same for the Web Title but the A/B test. The path that is used is login_elem_no_such_exception_2 and condition is raised when cookie exist but cannot be used for any reason.

elulcao picture elulcao on 10 Oct 2020
👍1

@elulcao
understood, I trust in you! you are super! (Y)

tnx

Polkyanik picture Polkyanik on 10 Oct 2020

Yes I have the same issue when I remove the cookies. When I delete the cookies, I need to accept the cookies policies from instagram again. So the solution is not remove the cookies but if you did, need to accept the cookies policies again.

Some fix for this? I already have changed the title for Instagram. This is not the problem anymore, for me at least.

How exactly to change "Login" text to "Instagram"? Which .py script and which line?

mesol86 picture mesol86 on 11 Oct 2020
👍1

Having the same issue here.

luismiparra picture luismiparra on 11 Oct 2020

Is the problem already solved?

StivGiobs picture StivGiobs on 12 Oct 2020

I resolve only connect to my raspberry via vnc, start the script and manually click on "accept coockies"...
Only the First time, now the script work normally
If You cancel the cookie file the problem return

Booleboole picture Booleboole on 12 Oct 2020

I resolve only connect to my raspberry via vnc, start the script and manually click on "accept coockies"...
Only the First time, now the script work normally
If You cancel the cookie file the problem return

I鈥檓 on Mac OS. Is possible manually add cookie files into instapy folder?

If yes, how can I find the correct folder?

StivGiobs picture StivGiobs on 12 Oct 2020

I resolve only connect to my raspberry via vnc, start the script and manually click on "accept coockies"...
Only the First time, now the script work normally
If You cancel the cookie file the problem return

I鈥檓 on Mac OS. Is possible manually add cookie files into instapy folder?

If yes, how can I find the correct folder?

Sorry, is impossibile to create and put in folder the cookie file.
Firefox use an internal System to storage the cookie ( all the cookies in one file)
When you run the script (not in headless mode) in a PC or in your Mac, and when you see the message click on "agree cookies", will be create a new file.
The file is stored in InstaPy folder
INSTAPY/LOG/"YOUR USER" / "YOUR USER" _COOCKIE.PKL

Booleboole picture Booleboole on 12 Oct 2020

Basically guys, if you are using the browser and running the script on your computer, headless. Then you just need to update the xpath by adding the "Accept Cookie" button. Then in login.py make sure it accepts cookie first and then updates browser activity. Its not that difficult and since I ALWAYS have to accept cookie for some reason, this solution seems to work

itssmaxy picture itssmaxy on 13 Oct 2020

Hi All,
.
I have solved this issue doing some steps:

  1. Delete all logs about your workspace
  2. Cleanup all history of Firefox
  3. Run script and click on accept cookies and login manually.
  4. Stop script
  5. Run again script.
ismaeljmf picture ismaeljmf on 17 Oct 2020

This is my quick and dirty fix. Place it before .login() call.

    # Accept cookies quick and dirty fix.
    insta.browser.get('https://instagram.com/accounts/login')
    insta.browser.implicitly_wait(5)
    for element in insta.browser.find_elements_by_tag_name('button'):
        if element.text.strip().lower() == 'accept':
            element.click()
            break
tlaskyd picture tlaskyd on 19 Oct 2020
👍1

This is my quick and dirty fix. Place it before .login() call.

    # Accept cookies quick and dirty fix.
    insta.browser.get('https://instagram.com/accounts/login')
    insta.browser.implicitly_wait(5)
    for element in insta.browser.find_elements_by_tag_name('button'):
        if element.text.strip().lower() == 'accept':
            element.click()
            break

Which file I have to correct?

StivGiobs picture StivGiobs on 19 Oct 2020

This is my quick and dirty fix. Place it before .login() call.

    # Accept cookies quick and dirty fix.
    insta.browser.get('https://instagram.com/accounts/login')
    insta.browser.implicitly_wait(5)
    for element in insta.browser.find_elements_by_tag_name('button'):
        if element.text.strip().lower() == 'accept':
            element.click()
            break

Thanks. This helped me with my cookie issue I reported here:
https://github.com/timgrossmann/InstaPy/issues/5837

OnlyOneMoreHour picture OnlyOneMoreHour on 21 Oct 2020

This is my quick and dirty fix. Place it before .login() call.

    # Accept cookies quick and dirty fix.
    insta.browser.get('https://instagram.com/accounts/login')
    insta.browser.implicitly_wait(5)
    for element in insta.browser.find_elements_by_tag_name('button'):
        if element.text.strip().lower() == 'accept':
            element.click()
            break

Which file I have to correct?

> 
> 
> > This is my quick and dirty fix. Place it before .login() call.
> > ```
> >     # Accept cookies quick and dirty fix.
> >     insta.browser.get('https://instagram.com/accounts/login')
> >     insta.browser.implicitly_wait(5)
> >     for element in insta.browser.find_elements_by_tag_name('button'):
> >         if element.text.strip().lower() == 'accept':
> >             element.click()
> >             break
> > ```
> 
> Which file I have to correct?

util.py

@contextmanager
def smart_run(session, threaded=False):
    try:
# Accept cookies quick and dirty fix.
        session.browser.get('https://instagram.com/accounts/login')
        session.browser.implicitly_wait(5)
        for element in session.browser.find_elements_by_tag_name('button'):
         if element.text.strip().lower() == 'accept': 
            element.click()
            break

        session.login()
        yield
    except NoSuchElementException:
        # The problem is with a change in IG page layout
        log_file = "{}.html".format(time.strftime("%Y%m%d-%H%M%S"))
        file_path = os.path.join(gettempdir(), log_file)

        with open(file_path, "wb") as fp:
            fp.write(session.browser.page_source.encode("utf-8"))

        print(
            "{0}\nIf raising an issue, "
            "please also upload the file located at:\n{1}\n{0}".format(
                "*" * 70, file_path
            )
        )
    except KeyboardInterrupt:
        clean_exit("You have exited successfully.")
    finally:
        session.end(threaded_session=threaded)
OnlyOneMoreHour picture OnlyOneMoreHour on 21 Oct 2020

This is my quick and dirty fix. Place it before .login() call.

    # Accept cookies quick and dirty fix.
    insta.browser.get('https://instagram.com/accounts/login')
    insta.browser.implicitly_wait(5)
    for element in insta.browser.find_elements_by_tag_name('button'):
        if element.text.strip().lower() == 'accept':
            element.click()
            break

Where do i find the login.py file to add youre code?
I cannot fin dit in InstaPy folder Nor in my Solution folder

Thanks for your help!

EDIT: Found path it is as following: C:Users[WindowsUser]AppDataLocalProgramsPythonPython36-32Libsite-packagesinstapy

CryptoCodeing picture CryptoCodeing on 8 Nov 2020

This is my quick and dirty fix. Place it before .login() call.

    # Accept cookies quick and dirty fix.
    insta.browser.get('https://instagram.com/accounts/login')
    insta.browser.implicitly_wait(5)
    for element in insta.browser.find_elements_by_tag_name('button'):
        if element.text.strip().lower() == 'accept':
            element.click()
            break

Which file I have to correct?

> 
> 
> > This is my quick and dirty fix. Place it before .login() call.
> > ```
> >     # Accept cookies quick and dirty fix.
> >     insta.browser.get('https://instagram.com/accounts/login')
> >     insta.browser.implicitly_wait(5)
> >     for element in insta.browser.find_elements_by_tag_name('button'):
> >         if element.text.strip().lower() == 'accept':
> >             element.click()
> >             break
> > ```
> 
> Which file I have to correct?

util.py

@contextmanager
def smart_run(session, threaded=False):
    try:
# Accept cookies quick and dirty fix.
        session.browser.get('https://instagram.com/accounts/login')
        session.browser.implicitly_wait(5)
        for element in session.browser.find_elements_by_tag_name('button'):
         if element.text.strip().lower() == 'accept': 
            element.click()
            break

        session.login()
        yield
    except NoSuchElementException:
        # The problem is with a change in IG page layout
        log_file = "{}.html".format(time.strftime("%Y%m%d-%H%M%S"))
        file_path = os.path.join(gettempdir(), log_file)

        with open(file_path, "wb") as fp:
            fp.write(session.browser.page_source.encode("utf-8"))

        print(
            "{0}\nIf raising an issue, "
            "please also upload the file located at:\n{1}\n{0}".format(
                "*" * 70, file_path
            )
        )
    except KeyboardInterrupt:
        clean_exit("You have exited successfully.")
    finally:
        session.end(threaded_session=threaded)

C:Users[WindowsUser]AppDataLocalProgramsPythonPython36-32Libsite-packagesinstapy

CryptoCodeing picture CryptoCodeing on 8 Nov 2020

Guys just the following code into the login_util.py file! If you could not find the file, than just use the debugger of your IDE and go step by step through you quickfile.py

........
def login_user(
browser,
username,
password,
logger,
logfolder,
proxy_address,
security_code_to_phone,
security_codes,
want_check_browser,
):
"""Logins the user with the given username and password"""
assert username, "Username not provided"
assert password, "Password not provided"

# Hotfix - this check crashes more often than not -- plus in not necessary,
# I can verify my own connection
if want_check_browser:
    if not check_browser(browser, logfolder, logger, proxy_address):
        return False

ig_homepage = "https://www.instagram.com"
web_address_navigator(browser, ig_homepage)

Here comes the important code to put in !!!!!

for element in browser.find_elements_by_tag_name('button'):
    if element.text.strip().lower() == 'accept':
        element.click()
        break

here the important code ends!!!!!!

cookie_file = "{0}{1}_cookie.pkl".format(logfolder, username)
cookie_loaded = None
login_state = None

# try to load cookie from username
try:
    for cookie in pickle.load(open(cookie_file, "rb")):
        # SameSite = Strict, your cookie will only be sent in a
        # first-party context. In user terms, the cookie will only be sent
        # if the site for the cookie matches the site currently shown in
        # the browser's URL bar.
        if "sameSite" in cookie and cookie["sameSite"] == "None":
            cookie["sameSite"] = "Strict"

        browser.add_cookie(cookie)
Abassina picture Abassina on 26 Dec 2020
Was this page helpful?
0 / 5 - 0 ratings

Related issues

n0sw34r picture n0sw34r  路  3Comments
tibor picture tibor  路  3Comments
seuraltimez picture seuraltimez  路  3Comments
deronsizemore picture deronsizemore  路  3Comments
Naramsim picture Naramsim  路  3Comments