TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Show HN: I made a Chrome extension that can automate any website

707 pointsby namukangover 3 years ago

73 comments

gandalfffover 3 years ago
I'm a speech therapist who does teletherapy. I routinely fill out a lot of web forms. I've already created one automation that will save me time, and I have ideas for several more automations. Thank you so much for making this!
评论 #29256681 未加载
评论 #29263119 未加载
评论 #29260753 未加载
cxrover 3 years ago
Some prior art:<p>&quot;CoScripter&quot; (2007) &lt;<a href="https:&#x2F;&#x2F;blog.mozilla.org&#x2F;labs&#x2F;2007&#x2F;09&#x2F;coscripter&#x2F;" rel="nofollow">https:&#x2F;&#x2F;blog.mozilla.org&#x2F;labs&#x2F;2007&#x2F;09&#x2F;coscripter&#x2F;</a>&gt;<p>&quot;IBM Automates Firefox With CoScripter&quot; (2007) &lt;<a href="https:&#x2F;&#x2F;www.informationweek.com&#x2F;software&#x2F;ibm-automates-firefox-with-coscripter" rel="nofollow">https:&#x2F;&#x2F;www.informationweek.com&#x2F;software&#x2F;ibm-automates-firef...</a>&gt;<p>&quot;Your personal assistant on the Web&quot; (2010) &lt;<a href="https:&#x2F;&#x2F;www.ibm.com&#x2F;blogs&#x2F;research&#x2F;2010&#x2F;10&#x2F;your-personal-assistant-on-the-web&#x2F;" rel="nofollow">https:&#x2F;&#x2F;www.ibm.com&#x2F;blogs&#x2F;research&#x2F;2010&#x2F;10&#x2F;your-personal-ass...</a>&gt;<p>&quot;Koala: Capture, Share, Automate, Personalize Business Processes on the Web&quot; (2007) &lt;<a href="https:&#x2F;&#x2F;ofb.net&#x2F;~tlau&#x2F;research&#x2F;papers&#x2F;koala-chi07.pdf" rel="nofollow">https:&#x2F;&#x2F;ofb.net&#x2F;~tlau&#x2F;research&#x2F;papers&#x2F;koala-chi07.pdf</a>&gt;<p>&quot;CoScripter: Sharing ‘How-to’ Knowledge in the Enterprise&quot; (2007) &lt;<a href="https:&#x2F;&#x2F;ofb.net&#x2F;~tlau&#x2F;research&#x2F;papers&#x2F;leshed-group07.pdf" rel="nofollow">https:&#x2F;&#x2F;ofb.net&#x2F;~tlau&#x2F;research&#x2F;papers&#x2F;leshed-group07.pdf</a>&gt;<p>&quot;Here’s What I Did: Sharing and Reusing Web Activity with ActionShot&quot; (2010) &lt;<a href="https:&#x2F;&#x2F;ofb.net&#x2F;~tlau&#x2F;research&#x2F;papers&#x2F;p723-li.pdf" rel="nofollow">https:&#x2F;&#x2F;ofb.net&#x2F;~tlau&#x2F;research&#x2F;papers&#x2F;p723-li.pdf</a>&gt;<p>Demo: &lt;<a href="https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=lKIex_XAxWw" rel="nofollow">https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=lKIex_XAxWw</a>&gt;<p>Source code (bitrotted, of course): &lt;<a href="https:&#x2F;&#x2F;github.com&#x2F;jeffnichols-ibm&#x2F;coscripter-extension" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;jeffnichols-ibm&#x2F;coscripter-extension</a>&gt;
评论 #29260548 未加载
评论 #29266354 未加载
评论 #29264367 未加载
mentheover 3 years ago
As a web scraper, I&#x27;ll say that because he is hooking into the browser like a debugger &#x2F; remotely controlled browser, just like Puppeteer would - he is instantly detected by the Cloudflare, PerimeterX, Datadome bot management solutions; and will get consistently banned on his page reload for literally any site caring about bots.<p>He&#x27;d be better off running some javascript on the page instead (a-la Tampermonkey, but can be done really nicely with some server-served TypeScript) to scrape the pages stealthily and perform actions.
评论 #29262765 未加载
评论 #29262248 未加载
评论 #29262768 未加载
评论 #29263957 未加载
kulikalovover 3 years ago
This project seem to be consumer-friendly. You should mention to users that:<p>1. By sharing authentication cookies they provide full control over their personal account<p>2. By using this automation they often violate Terms of Services and may be banned.
评论 #29262578 未加载
sly010over 3 years ago
Congrats, the demos look awesome! Having struggled with something like this in the past (for automated testing) I am always curious about how various solutions represent the &quot;program&quot; so its long term repeatable?<p>I often had to manually add branching on certain conditions (i.e login) or waiting for certain conditions (elements appearing) before proceeding.<p>I also often had to manually tweak selectors and even matches on html structurally (css selectors cannot select a parent element based on a matching content element).<p>Then there are the webpacked react sites that scramble css class names that change all the time.<p>Some of these things are super tedious to solve for even manually so I am just curious how no-code tools handle these?
评论 #29258334 未加载
renatgabitovover 3 years ago
DK, congrats on the launch. You are onto something with data extraction. I like that you allow to correct the selectors, so that the data can be extracted more accurately, and typing.<p>I found the UI slight challenging because of a popup window that opens. Resizing is tricky. Overlay would make is so much easier.<p>Our team at Bardeen.ai has built a workflow automation tool. We also have a scraper to extract data. But our full automation engine (similar to Zapier&#x2F;Integromat) allows to tap into the full power of web apps. Like creating a new Google Sheet &#x2F; Airtable &#x2F; Notion with the scraped data and then triggering follow up actions.<p>If you are curious, here is a “live build” that I did for the Twitter --&gt; Airtable use case. <a href="https:&#x2F;&#x2F;www.bardeen.ai&#x2F;posts&#x2F;scrape-twitter" rel="nofollow">https:&#x2F;&#x2F;www.bardeen.ai&#x2F;posts&#x2F;scrape-twitter</a><p>Jon mentioned in the other thread automated screenshots. We get screenshots of all of our dashboards from Google Analytics + Posthog sent to our Slack daily. <a href="https:&#x2F;&#x2F;www.bardeen.ai&#x2F;playbooks&#x2F;send-website-screenshots-in-slack" rel="nofollow">https:&#x2F;&#x2F;www.bardeen.ai&#x2F;playbooks&#x2F;send-website-screenshots-in...</a><p>Either way, great job there! Love seeing new automation projects pop up.<p>P.S. - I saw there is an “input” action. Can I feed your automation tool a spreadsheet of data and have it fill out form? (one per row)
评论 #29274973 未加载
评论 #29259910 未加载
namukangover 3 years ago
Hi HN,<p>About 14 years ago, I fell in love with programming because it made me feel like a magician. I&#x27;d type in some incantations, click &quot;Run&quot;, and voila! My lightning-powered thinking rock would do exactly as I commanded — in my case, make a virtual robot named Karel move around the screen in my computer science lab.<p>Nowadays, casting spells requires a bit more work. Most of our work happens inside complex web apps that each have their own custom spell books (APIs) — assuming they even provide one at all.<p>Let&#x27;s take a task like managing your social media accounts. Suppose you want to reset your Twitter account and start from scratch. First step: Unfollow everyone. The problem is that you have hundreds of accounts to unfollow, and you don&#x27;t exactly want to sit there all day clicking buttons.<p>If you&#x27;re not a programmer, your options are limited to what others have built. You can hand over your credentials to all kinds of third-party apps and extensions in the hopes of finding one that works. Good luck.<p>If you&#x27;re a programmer, you have more options. You have the power to cast spells. What if we used the official API?<p>You can sign up for a developer account, get an API key, download a client library, read about how OAuth works for the hundredth time, and then start digging through the API to find out how to complete your task.<p>That sounds tedious and creating a developer account for a one-off task feels like overkill. What if we simulated user actions in the browser instead?<p>You can install Selenium&#x2F;Puppeteer&#x2F;Playwright, read through its documentation to learn how to navigate and click, open the web inspector to figure out the right CSS selectors, run into some race condition where the elements aren&#x27;t loading in time, sprinkle in some waits, and puzzle over how to handle elements being added from the infinite scrolling list.<p>That doesn&#x27;t sounds too great either. Maybe it&#x27;d be faster to manually click those buttons after all...<p>I built Browserflow to automate tasks like this where people end up wasting time doing what computers do better. I wanted a tool that makes it easy for anyone, regardless of their technical background, to automate any task on any website. It includes the convenience of features like automatically generating automation steps by recording your actions while having the flexibility of letting you tweak anything manually or write custom Javascript. (If you want to see how simple it is to automate the Twitter task above using Browserflow, here&#x27;s the demo: <a href="https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=UnsGTpcA-98" rel="nofollow">https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=UnsGTpcA-98</a>)<p>Building a browser automation tool from scratch and making it robust enough to handle all kinds of websites took much, much longer than I expected. After working on it as a solo developer for 1.5 years, I&#x27;m super excited to finally share this with you all. Whether you&#x27;re a professional developer or a non-technical marketer, I hope Browserflow will make you feel like a magician on the Web.<p>Would love to get your feedback!
评论 #29261059 未加载
评论 #29258673 未加载
jonshariatover 3 years ago
If this could take screenshots, I would signup in a heartbeat.<p>Here is my need (and I&#x27;ve had this need my whole working career&quot;: What does production look like?<p>If a tool could automate loggin in, browsing specific flows, take screenshots of every page, and add them to a folder of the day, it would invaluable.
评论 #29257440 未加载
评论 #29258443 未加载
评论 #29257405 未加载
评论 #29257706 未加载
评论 #29258081 未加载
评论 #29264139 未加载
评论 #29261404 未加载
评论 #29273692 未加载
评论 #29267419 未加载
tyingqover 3 years ago
Too bad headless chrome seems uninterested in supporting browser extensions...&quot;wontfix&quot;<p><a href="https:&#x2F;&#x2F;bugs.chromium.org&#x2F;p&#x2F;chromium&#x2F;issues&#x2F;detail?id=706008" rel="nofollow">https:&#x2F;&#x2F;bugs.chromium.org&#x2F;p&#x2F;chromium&#x2F;issues&#x2F;detail?id=706008</a><p>Otherwise, you could make a pretty neat self-hosted &quot;cloud&quot; of this nice looking scraper extension.
评论 #29256607 未加载
评论 #29261213 未加载
keyleover 3 years ago
Pretty cool and well presented.<p>I have concerned with any of the gallery items that advertise &#x27;scraping&#x27; of Linkedin data. You might want to keep that on the down-low.<p>IMNAL but I&#x27;m pretty sure that&#x27;s grounds for getting you shut down.
评论 #29261099 未加载
jokethrowawayover 3 years ago
Really neat, that&#x27;s the kind of stuff I always wanted someone to build. I think a marketplace of workflows would be a great next step, so that you can have someone else maintaining the flows.<p>I build tons of scraper and things that pretend to be browser (handcoded, not recorded from the browser - but lighter than spinning up a real browser) and the harder bit is keeping the flows maintained. Some websites are particularly annoying to work with because of random captchas jumping in your face but it&#x27;s something you can handle by coding support for the captcha in the flow and presenting a real user the captcha.<p>One problem of logging in the cloud is IP checks. You may be asked to confirm.<p>If you want to look into this issues I&#x27;d recommend scraping yandex for dealing with captchas being thrown in your face and authed google or facebook for IP restrictions, weird authentication requests.<p>Again, I think a marketplace could outsource these problems to a community of developers maintaining flows.<p>Security could be another concern, but you always have the option of running things locally.
评论 #29256827 未加载
fender256over 3 years ago
I would love it if this extension was made for Firefox!
评论 #29260047 未加载
catchmeifyoucanover 3 years ago
Beautiful UI. Hope this takes off. Love the simplicity of the design and the ease of use. If it could make writing my Cypress UI tests easier, that might be another adjacent problem to look into, by logging the recorded elements as code.
评论 #29256076 未加载
RandomBookmarksover 3 years ago
I like the name. But how is this extension different from iMacros, Selenium IDE or UI.vision?<p>These extensions are some well-known browser automation tools, each with &gt; 100K users.<p>Did you look at them and decided to do something different?
评论 #29256537 未加载
评论 #29256542 未加载
rohanm93over 3 years ago
So good - I came across your updates on Twitter and was blown away by how mature this product is already, especially at launch. Congratulations!<p>I’m also a user of your other Chrome app you developed (Intention) [1] - I’d recommend people try that out too (simple free app for productivity), it’s also so good.<p>Good luck with the launch!<p>[1] <a href="https:&#x2F;&#x2F;chrome.google.com&#x2F;webstore&#x2F;detail&#x2F;intention-stop-mindless-b&#x2F;dladanhaondcgpahgiflodhckhoeohoe?hl=en" rel="nofollow">https:&#x2F;&#x2F;chrome.google.com&#x2F;webstore&#x2F;detail&#x2F;intention-stop-min...</a>
评论 #29261689 未加载
klaudiozover 3 years ago
For free, the Max run frequency is once a day and the runs are 50&#x2F;month, but it&#x27;s imposible to reach it.
insaiderover 3 years ago
Neat dude! One tip - I&#x27;d add subtitles to your demo vid.
deedubayaover 3 years ago
Neat!<p>I think your business plans are underpriced. You&#x27;re saving human hours with increased accuracy, which probably is worth more than $25&#x2F;month.<p>edit: nevermind. Your annual pricing shows per-month pricing which is $299&#x2F;month.
评论 #29259794 未加载
phpisatrashover 3 years ago
Why should I pay for this if Automa is free open source and better?<p><a href="https:&#x2F;&#x2F;github.com&#x2F;Kholid060&#x2F;automa" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;Kholid060&#x2F;automa</a>
mountainboyover 3 years ago
hmm, I installed extension, clicked on &quot;Get Started&quot;, allowed permissions, and am then presented with a signup&#x2F;signin page and no way to skip it.<p>I just want to run some macros locally. Not interested in &quot;cloud&quot; anything unless its on a server that I control.<p>Questions&#x2F;comments:<p>1. Will local functionality work without signup?<p>2. If so, then please consider a &quot;Get Started&quot; flow that makes this clear and does not require signup before giving any instruction&#x2F;usage.
评论 #29259257 未加载
评论 #29260020 未加载
toss1over 3 years ago
Excellent work; I started the demo with usual jaded attitude, but then - WOW - nice - I&#x27;ll have good uses for that!<p>Can you drive actions from a spreadsheet or table? The workflow I&#x27;m thinking of is first do a run to gather data, next offline filter or select desired items from that data set, then finally use the processed data set to drive a series of actions on the selected items.<p>Also, any chance there&#x27;ll be a Firefox version?
评论 #29258625 未加载
MrAwesomeover 3 years ago
DK! Happy to see a new project from you. I&#x27;m a die-hard Hide Feed fan.<p>This reminds me fondly of using Vimperator macros and link hints to automate tasks back in 2007. It has always surprised me that the most widely-used UI paradigm lacks a standard way to automate tasks - we all spend so much of our lives clicking links, it seems insane that there isn&#x27;t more&#x2F;standard tooling for automating that.
评论 #29261841 未加载
eulercoderover 3 years ago
Congratulations DK, this looks amazing!<p>We are building similar tool at TexAu and would love to catch-up with you sometime this or next week!<p>@iamvikeshtiwari on Twitter
Meglisover 3 years ago
I have somewhat of the same system involving selenium + a python scrape engine + jenkins + docker containers with headless chrome.
评论 #29260703 未加载
debdutover 3 years ago
Damn dk! This is awesome I’m following you and browserflow sometime. This post should be on top for days straight atleast guys
评论 #29256857 未加载
guerrillaover 3 years ago
Cool. This reminds me of AppleScript. I miss those days. I&#x27;m surprised GNOME still doesn&#x27;t have something that easy.
kaycebasquesover 3 years ago
Presumably using Chrome DevTools Protocol? Or maybe that new Recorder panel stuff [1] in DevTools has unlocked some new capabilities for Extensions?<p>[1] <a href="https:&#x2F;&#x2F;twitter.com&#x2F;JecelynYeen&#x2F;status&#x2F;1458089611004162060" rel="nofollow">https:&#x2F;&#x2F;twitter.com&#x2F;JecelynYeen&#x2F;status&#x2F;1458089611004162060</a>
评论 #29261787 未加载
moritonalover 3 years ago
Whilst nice, how is this going to handle the changing nature of the web? It&#x27;s nice that it detects &quot;lists&quot; and such, but a few changes to CSS is going to trash that automation right?<p>I&#x27;m also fairly sure you&#x27;ll break (either directly, or on a user&#x27;s behalf) a few EULA&#x27;s that really specifically ban scraping.
评论 #29260327 未加载
评论 #29258424 未加载
anaskarover 3 years ago
This is awesome. Congratulations on the launch. I can see a number of use cases for Marketing, CS, and Sales orgs
thih9over 3 years ago
Congrats, looks great, especially the UX.<p>Could you elaborate on cloud runs and cookies? E.g.:<p>- How are the cookies obtained? I saw that in the video you clicked the &quot;add&quot; button at 1:36, how does this work and what happens behind the scenes?<p>- How long do the cookies remain in use? Does the user have to refresh cookies manually at some point?
评论 #29256452 未加载
skrowlover 3 years ago
Sounds similar to Microsoft Power Automate, though Power Automate works with browsers other than Chrome.
Drblessingover 3 years ago
This is amazing!<p>I&#x27;m excited to see if this will remain available long-term or websites will try to figure out ways to block it, and the limit to data scraping from one script, for example if a twitter account had 1 mil followers could it do all of them in day. I&#x27;m going to try it out!
评论 #29259916 未加载
reeddavidover 3 years ago
Looks great, I&#x27;ll give it a try for my next scraping project. My favorite of all these types of tools was kimonolabs (<a href="http:&#x2F;&#x2F;kimonolabs.com" rel="nofollow">http:&#x2F;&#x2F;kimonolabs.com</a>) before they were acquired and shut down.
评论 #29263667 未加载
morbmover 3 years ago
FYI you can run this tool locally, but it cannot save the results locally. It requires Google Drive to upload the data to a spreadsheet. File download&#x2F;screenshot does support local execution though.<p>Can&#x27;t schedule locally either, only in the cloud.
tmcnealover 3 years ago
Congrats on the launch DK! It&#x27;s awesome to see how polished you&#x27;ve made this.
评论 #29257554 未加载
xeromalover 3 years ago
So this is very specific, but I&#x27;ve been trying to automate clearing my linked in messages for a while and I just tried browserfow to no success. I tried using the selector and also grabbing css paths off random elements.<p>Any idea how to debug?
评论 #29258851 未加载
vxNsrover 3 years ago
Just curious, why do you offer residential ips? My initial thoughts are reseller botting, but it honestly seems kinda slow for that, not to mention max rate of 1&#x2F;min. So what else are residential ips good for?
评论 #29256736 未加载
评论 #29256818 未加载
AnonHPover 3 years ago
I’m a bit confused with the Pricing page. Does the Chrome extension limit of 30 minutes per month in the free plan mean that completely local use on one’s computer is restricted by time? How is this tracked?
评论 #29261806 未加载
mrwwwover 3 years ago
YES! I have been wanting a solution to automate some of my simpler web-scraping needs, that also need an element of human control. Thank you for making it so i didnt have to :) Cant wait to try it out
nzachover 3 years ago
This looks really interesting!<p>Do you have any plans to port it to also run on Firefox?
评论 #29256938 未加载
newman314over 3 years ago
I&#x27;m going to try using this to update certs on my Brother printer. It is one of the few that I have been unable to automate&#x2F;hack together something for LE cert rotation.
adamrezichover 3 years ago
I was just thinking about how I wanted something exactly like this for certain tasks I need to do daily or weekly at work! does it have support for filling out file upload forms?
评论 #29261800 未加载
TavsiE9sover 3 years ago
Why would I need to signup if I only ever want to run local flows?
terrycodyover 3 years ago
Nice job! I am wondering if such plugin can automate across browser and desktop? Like the Imacro premium functions? You can even open docs, manipulate across multiple things.
wekaover 3 years ago
Beautiful UI. What&#x27;s the framework -- React? Vue? Angular?
评论 #29256660 未加载
hnrodeyover 3 years ago
This is so slick. I think I&#x27;ll give it a try. Thanks!
SergeAxover 3 years ago
Sincirely interested in: are there other examples of software running locally on my PC, but with work time limitation depending on subscription plan?
VeninVidiaViciiover 3 years ago
I definitely would have loved this in February when I had to upload 40 genomes to the NCBI, using the same format. Cheers and this looks awesome.
hk1337over 3 years ago
This looks really, really nice. I had my doubts going into it but the demo really blew that away.<p>I saw you can save to CSV, can it save to other file formats?
评论 #29262036 未加载
butler14over 3 years ago
I’ve dabbled with lots of RPA software but never settled on one, mostly due to poor UX or the need to write code. Will give this a whirl!
mritchie712over 3 years ago
Nice work! I&#x27;ve been trying a few similar tools. How do you handle auth (e.g. LinkedIn) when the work is running in the cloud?
评论 #29255686 未加载
评论 #29255908 未加载
minusSevenover 3 years ago
I tried it but somehow couldn&#x27;t get the extension to populate the data in google sheet. Also the UI sort of feels convoluted.
pkover 3 years ago
Any plans to support HTTP authentication?<p>This is wonderful! It could save us from having to hire an administrative assistant to do manual scraping.
评论 #29269217 未加载
inafewwordsover 3 years ago
Thank you<p>You&#x27;ll save me from arthritis and carpal tunnel
WORMS_EAT_WORMSover 3 years ago
This is excellent… Congrats and super useful!<p>I will no longer write some pretty gnarly jQuery in console to do the same thing.
bennnymover 3 years ago
Can the extension handle logging in to a website? How can we store our user name and password securely?
评论 #29261780 未加载
评论 #29261401 未加载
geoka9over 3 years ago
Very nice! Just be careful, Twitter is pretty aggressive with banning accounts that use automation.
ghostbrainalphaover 3 years ago
It&#x27;s impressive. What&#x27;s been the biggest challenge building it so far?
评论 #29261818 未加载
countvonbalzacover 3 years ago
Do you think this could be used for testing purposes as well, not just scraping?
评论 #29258918 未加载
评论 #29258782 未加载
mmmmkayover 3 years ago
this is dope! I&#x27;ve been thinking about building something this for a few months now. Glad to see that I don&#x27;t have to anymore! :D
slugiscool99over 3 years ago
Really great job with this. Definitely fills a need
delaaxeover 3 years ago
Countless startups have been started on this idea
评论 #29263664 未加载
scrumlordover 3 years ago
A couple of issues from where we stand:<p>&quot;Save time by automating repetitive tasks in your own browser or in the cloud.&quot; My own browser? Our shop uses Firefox because we don&#x27;t support Google&#x27;s anti-competitive behavior or their support of Chinese ethnic cleansing.<p>&quot;Web automation for everyone&quot; Sure, except for the people you exclude from your club for not using Chrome and suckling Google&#x27;s communist teat.
visargaover 3 years ago
Can you compare with UiPath?
dxl32over 3 years ago
Congrats on the launch DK!!!
agumonkeyover 3 years ago
Impressive work :) #jealous
davidhaririover 3 years ago
Well made. Nice work
armchairhackerover 3 years ago
that is a very well-made presentation, congrats
princevegeta89over 3 years ago
Excellent idea.
aseboldover 3 years ago
Very helpful for automating hiding “topics” on Twitter!
评论 #29258499 未加载
rafaelturkover 3 years ago
Neat. Love it.
crawsomeover 3 years ago
i remember iMacros
1cvmaskover 3 years ago
Good luck! Is there a special price or discount for HN community?