Git Product home page Git Product logo

insta-fetcher's Introduction

Hi there

Sing Ndelok

๐Ÿ‘ค About Me

  • Web Scraping Enthusiast
  • ๐Ÿคทโ€โ™‚๏ธ 21 y.o ordinary boy interested in Back End Development
  • ๐Ÿ  Live at Magelang, Indonesia

๐Ÿ“Š Github Stats

Gimenz's github stats

โŒš Coding Stats

No activity tracked

insta-fetcher's People

Contributors

ev4ndropc avatar gimenz avatar harsh253 avatar wahdalo avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar

insta-fetcher's Issues

Blocked account

After a few weeks of successfully scraping my ig account has been suspended. Is there any solution to minimize the possibility of getting banned? For example making requests from several different accounts (how many?) or using the same user agent from which the account was created. Does anyone know what instagram pays attention to when banning an account?

File System read-only

I'm trying to use your code on a host that has only read-only access to storage, so storing cookies in a text file is making a problem.
Is there any way you could make it possible so it would use memory data only? Like an option to set when making an instance of igApi.

429: Too many requests

Even a low request rate (about 1 per minute) causes 429 error from instagram api, wchich already lasts more than an hour. Does instagram block my server IP? Is there any workaround?

Axios error

Request failed with status code 400
Having this issue for 2 weeks

Version: 1.3.21

CORS Error

Getting a CORS error when trying your example. Seems like Insta blocked this

Proxy

Hello there can you integrate a proxy in your module as instagram blocks the get sessionid when running on google cloud shell,,

bingung

ini cara make proxy gmna dah bang
mksd gw url proxy nya ini nyari dimana

_getReelsIds is not getting the reels only highlight

I was testing the api and realized that this method does not get the reels, only the highlights, I believe it is an error because there is already a function to get the highlights which would be fetchHighlights.

Too Many Redirects

Error [ERR_FR_TOO_MANY_REDIRECTS]: Maximum number of redirects exceeded

getting this message after using featchPost funtion

pls help.

[ BUG ] CANNOT READ PROPERTIES

const item = metadata.items[0];
^
TypeError: Cannot read properties of undefined (reading '0')
at igApi. (/data/data/com.termux/files/home/scraper-ig/node_modules/insta-fetcher/dist/index.js:178:40)
at Generator.next ()
at fulfilled (/data/data/com.termux/files/home/scraper-ig/node_modules/insta-fetcher/dist/index.js:35:58)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)

Question about Cookies duration

I have a question about the cookie management. As I can see you store three Cookies in the "insta-fetcher/dist/config/Cookies.txt", the csrftoken, the ds_user_id and the sessionid. I'm not sure if I'm correct, but I checked the lifetime of these cookies and two of them have a lifetime of a year and one of them has a lifetime of three months. My question is if I need to be generating Cookies periodically.

Fetch media limit

Hi, thanks for the package really saved me,

I had a question, how can I limit the fetch media results? I pass the end_cursor=12 but it gets an error? please help

medias = await ig.fetchUserPostsV2('adele', 12)

Video Type Media Does not return video_url

Adding a sample node json response where 'is_video' : true but it does not have a video_url as stated in the docs. I see that it is an optional key so wanted to understand if only few kind of videos return a video_url

image

Get all profile posts

Hey @Gimenz !

Is there a way how to paginate and scrape all user posts? For now it gets only 12 posts.

I found page_info object and it seems that it can be used for this purposes.

Do you have any ideas?

Thanks & Regards,
Ilya

401 Authorized

I think I got my ip banned from accessing the instagram api too much. But I changed the proxy and cookies (new account) I still can't access it

TypeError: Cannot read property 'shortcode_media' of undefined

Hi,

When I'm trying your FetchPost exemple, I have the following error :
TypeError : Cannot read property 'shortcode_media' of undefined

And if I am trying FetchUser :
TypeError : Cannot read property 'user' of undefined (Line 112 of index.js)

Do I need a sessionId so it will works ?

"instagram.com/USERNAME/?__a=1&__d=dis" returns 404

When requesting an instagram account with the payload: '?__a=1&__d=dis', now returns a 404 page not found. This is used within multiple methods, for example the getIdByUsername() method

image

image

When requesting this URL from a browser. It also returns 404.

image

I'm not sure of a workaround to this yet, if you know anything let me know

session_id not generated

tried many times
error - throw new Error('Username or password is incorrect. Please check and try again');
^

Error: Username or password is incorrect. Please check and try again
at d:\Github\MyBitBot-MD\node_modules\insta-fetcher\dist\helper\Session.js:76:19
at Generator.next ()
at fulfilled (d:\Github\MyBitBot-MD\node_modules\insta-fetcher\dist\helper\Session.js:5:58)
at processTicksAndRejections (node:internal/process/task_queues:96:5)

with same username and password i'm able to login in chrome.
help

ERR_UNHANDLED_REJECTION

hi
first very tnx to build library...
then
i have a profblem in code
when i lunch this code with node filename.js
i am getting ERR_UNHANDLED_REJECTION error

actually when i login into instgram and do some thing (refresh load, accept Instagram notice, ,like,comment ....)
this error removed.
but now this solution not working and on all request i have error ERR_UNHANDLED_REJECTION

i get new cookie and use it ,but error not remove
please help me to solve this issue

how to get session id???

most people asking this question, to get session id is easier, but they lazy to find it on the dev tools or chrome extension.
if you want to get cookie/sess id with one click, you can watch this (need Computer). => How to Get Facebook/Instagram's Cookie

for mobile, you can try eruda. 
don't be lazy bruh. happy coding :)

next time, i'll add some function to get session id, any terminal maybe can use it. may it's requires login username and password. is safe bcz don't store username and password locally, or i didn't put logger here ๐Ÿ˜ƒ

I get a 404 error

hi
I get a 404 error for any method I call today. Have there been any changes? I would appreciate it if you could check. Thank you.

`node:internal/process/promises:279
triggerUncaughtException(err, true /* fromPromise */);
^

[UnhandledPromiseRejection: This error originated either by throwing inside of an async function without a catch block, or by rejecting a promise which was not handled with .catch(). The promise rejected with the reason "AxiosError: Request failed with status code 404".]`

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.