- Web Scraping Enthusiast
- ๐คทโโ๏ธ 21 y.o ordinary boy interested in Back End Development
- ๐ Live at Magelang, Indonesia
No activity tracked
simple instagram metadata scraping
Home Page: https://www.npmjs.com/package/insta-fetcher
License: GNU General Public License v3.0
After a few weeks of successfully scraping my ig account has been suspended. Is there any solution to minimize the possibility of getting banned? For example making requests from several different accounts (how many?) or using the same user agent from which the account was created. Does anyone know what instagram pays attention to when banning an account?
I'm trying to use your code on a host that has only read-only access to storage, so storing cookies in a text file is making a problem.
Is there any way you could make it possible so it would use memory data only? Like an option to set when making an instance of igApi.
Even a low request rate (about 1 per minute) causes 429 error from instagram api, wchich already lasts more than an hour. Does instagram block my server IP? Is there any workaround?
Request failed with status code 400
Having this issue for 2 weeks
Version: 1.3.21
Getting a CORS error when trying your example. Seems like Insta blocked this
Hello there can you integrate a proxy in your module as instagram blocks the get sessionid when running on google cloud shell,,
In How Much Days Cookies Get Expire?, Becoz insta-fetcher
Requires New session-id
Everyday!, I Am Lil Bit Confused About That Why It Shows!
Request supaya instastorynya bisa pakai link.
ini cara make proxy gmna dah bang
mksd gw url proxy nya ini nyari dimana
I was testing the api and realized that this method does not get the reels, only the highlights, I believe it is an error because there is already a function to get the highlights which would be fetchHighlights.
Error [ERR_FR_TOO_MANY_REDIRECTS]: Maximum number of redirects exceeded
getting this message after using featchPost funtion
pls help.
hello ..i put image link to anchor tag since i want to download image but instead od downlaoding its opeing in new tag..how to get rid of this ?
Hello!
After upgrading insta-fetcher
to ^1.3.22
I started getting the following error:
Error: read ECONNRESET
at TLSWrap.onStreamRead (node:internal/stream_base_commons:220:20)
when calling the getSessionId
function
const item = metadata.items[0];
^
TypeError: Cannot read properties of undefined (reading '0')
at igApi. (/data/data/com.termux/files/home/scraper-ig/node_modules/insta-fetcher/dist/index.js:178:40)
at Generator.next ()
at fulfilled (/data/data/com.termux/files/home/scraper-ig/node_modules/insta-fetcher/dist/index.js:35:58)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
I have a question about the cookie management. As I can see you store three Cookies in the "insta-fetcher/dist/config/Cookies.txt", the csrftoken, the ds_user_id and the sessionid. I'm not sure if I'm correct, but I checked the lifetime of these cookies and two of them have a lifetime of a year and one of them has a lifetime of three months. My question is if I need to be generating Cookies periodically.
Hi, thanks for the package really saved me,
I had a question, how can I limit the fetch media results? I pass the end_cursor=12 but it gets an error? please help
medias = await ig.fetchUserPostsV2('adele', 12)
Hey @Gimenz !
Is there a way how to paginate and scrape all user posts? For now it gets only 12 posts.
I found page_info
object and it seems that it can be used for this purposes.
Do you have any ideas?
Thanks & Regards,
Ilya
I think I got my ip banned from accessing the instagram api too much. But I changed the proxy and cookies (new account) I still can't access it
Hi,
When I'm trying your FetchPost exemple, I have the following error :
TypeError : Cannot read property 'shortcode_media' of undefined
And if I am trying FetchUser :
TypeError : Cannot read property 'user' of undefined
(Line 112 of index.js)
Do I need a sessionId so it will works ?
When requesting an instagram account with the payload: '?__a=1&__d=dis', now returns a 404 page not found. This is used within multiple methods, for example the getIdByUsername() method
When requesting this URL from a browser. It also returns 404.
I'm not sure of a workaround to this yet, if you know anything let me know
tried many times
error - throw new Error('Username or password is incorrect. Please check and try again');
^
Error: Username or password is incorrect. Please check and try again
at d:\Github\MyBitBot-MD\node_modules\insta-fetcher\dist\helper\Session.js:76:19
at Generator.next ()
at fulfilled (d:\Github\MyBitBot-MD\node_modules\insta-fetcher\dist\helper\Session.js:5:58)
at processTicksAndRejections (node:internal/process/task_queues:96:5)
with same username and password i'm able to login in chrome.
help
hi
first very tnx to build library...
then
i have a profblem in code
when i lunch this code with node filename.js
i am getting ERR_UNHANDLED_REJECTION error
actually when i login into instgram and do some thing (refresh load, accept Instagram notice, ,like,comment ....)
this error removed.
but now this solution not working and on all request i have error ERR_UNHANDLED_REJECTION
i get new cookie and use it ,but error not remove
please help me to solve this issue
most people asking this question, to get session id is easier, but they lazy to find it on the dev tools or chrome extension.
if you want to get cookie/sess id with one click, you can watch this (need Computer). => How to Get Facebook/Instagram's Cookie
for mobile, you can try eruda.
don't be lazy bruh. happy coding :)
next time, i'll add some function to get session id, any terminal maybe can use it. may it's requires login username and password. is safe bcz don't store username and password locally, or i didn't put logger here ๐
hi
I get a 404 error for any method I call today. Have there been any changes? I would appreciate it if you could check. Thank you.
`node:internal/process/promises:279
triggerUncaughtException(err, true /* fromPromise */);
^
[UnhandledPromiseRejection: This error originated either by throwing inside of an async function without a catch block, or by rejecting a promise which was not handled with .catch(). The promise rejected with the reason "AxiosError: Request failed with status code 404".]`
i m facing eror of too many request 429 status code
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.