Automating bulk web stuff with iMacros –

Automating bulk web stuff with iMacros

Posted on December 16th, 2013 by Sacha Chua
More posts about: geek Tags: automation, chrome, imacros, scripting, web // 2 Comments »

I found myself needing to download a whole bunch of JSON data from a server that had a weird authentication thing that Chrome could deal with but wget/curl/Ruby couldn’t. Since my Firefox was on the fritz, I couldn’t use Selenium IDE or the Selenium Webdriver. iMacros to the rescue! (Chrome, Firefox)

That plus lots of keyboard macros and text manipulation in Emacs, plus a little parsing and regexp substitution in Ruby, plus more Emacs munging got me the data I wanted. Hooray for bubblegum and string scripting!

More posts about: geek Tags: automation, chrome, imacros, scripting, web | See in index // 2 Comments »

You might like these…
About me

I'm Sacha Chua. I'm having lots of fun geeking out about parenting our three-year-old. I also compile Emacs News weekly. I'm infrequently on: Twitter - Github - Facebook -Slideshare - LinkedIn
For more info, check out the About page.
Free/pay-what-you-want resources
- Sketchnotes 2014
  Latest collection of sketchnotes and thoughts
- Emacs Chats - EPUB, MOBI
  A collection of transcripts from the Emacs Chat series
- Sketchnotes 2013
  300+ sketches about learning, sharing, tech, semi-retirement, business, delegation, and other topics. You'll get a ZIP file (290+ MB) with hi-res images that you can easily flip through or print.
- A No-Excuses Guide to Blogging
  What's getting in your way when it comes to blogging consistently? Check out this 42-page guide to ten common blogging excuses and how to break past them.
- How to Learn Emacs
  
  a hand-drawn one-pager for beginners
Find more resources
Categories
- -Uncategorized (1,979)
- book (66)
- braindump (19)
- business (333)
  - delegation (46)
  - entrepreneurship (53)
  - gen-y (16)
  - leadership (21)
  - management (13)
  - marketing (20)
  - productivity (100)
- communication (445)
  - connecting (196)
  - presentation (109)
  - speaking (117)
  - talk (10)
  - teaching (85)
  - toastmasters (17)
- event (146)
  - barcamp (18)
  - cascon (10)
  - conference (52)
  - democamp (19)
  - digitalpinay (19)
  - meetup (15)
- finance (55)
- geek (1,670)
  - analysis (24)
  - android (23)
  - design (7)
  - development (54)
  - drupal (87)
  - emacs (946)
    - bbdb (22)
    - emacs-news (172)
    - org (78)
    - planner (31)
    - wickedcoolemacs (44)
  - laptop (11)
  - linux (49)
  - lotus (16)
  - opensource (26)
  - quantified (86)
  - ruby (28)
    - rails (17)
  - wordpress (43)
- idea (12)
- issues (26)
- learning (447)
  - education (28)
  - japanese (15)
  - kaizen (184)
  - mentoring (15)
  - notetaking (22)
  - reading (67)
- life (1,674)
  - canada (55)
  - cat (52)
  - clothing (16)
  - cooking (147)
    - cookordie (65)
  - experiment (73)
  - family (113)
    - adphoto (17)
  - filipino (16)
  - friends (112)
    - barkada (22)
  - gardening (46)
  - goodkarma (13)
  - happy (41)
  - health (21)
  - japan (15)
  - library (16)
  - love (39)
  - party (22)
  - passion (48)
  - philippines (96)
  - photography (21)
  - purpose (36)
  - reflection (153)
  - sad (12)
  - school (79)
  - sewing (41)
  - story (13)
  - toronto (17)
  - travel (69)
- organization (21)
- organizer (15)
- parenting (67)
  - play (9)
- philosophy (16)
- planning (65)
- plans (31)
- podcast (44)
  - Emacs Chat (21)
  - emacs-basics (3)
  - Frugal FIRE (3)
  - Helpers Help Out (10)
- podcasting (3)
- process (23)
- research (52)
- review (794)
  - decision (55)
  - monthly (103)
  - weekly (596)
  - yearly (28)
- sharing (382)
  - drawing (92)
  - publishing (5)
  - writing (291)
    - blogging (190)
- social (39)
- Tidbits (10)
- time (34)
- tips (79)
- visual (374)
  - sketches (361)
    - sketchnotes (93)
    - visual-book-notes (39)
- women (44)
- work (338)
  - career (100)
  - enterprise2.0 (23)
  - ibm (99)
  - web2.0 (90)
Subscribe!
Subscribe to our mailing list

* indicates required

Your e-mail *

Type "Human" in the field below *

How often would you like to hear from me?
With each post: a daily stream of ideas

Weekly, monthly, and yearly updates: recommended

Monthly and yearly updates: neatly categorized

Once in a blue moon: yearly summaries, announcements

Just Emacs stuff

Email Format
html

text
Recent comments
- sachac We did that in the beginning, but A- likes to have lots of books. She requests specific ones or digs through the shelf herself. But... – How A- is helping me learn how to read better
- Tõenduspõhised nõuanded ükskõik millises töös edu saavutamiseks - Efektiivne Altruism Eesti […] Fadde ja Klein on kirjutanud suurepärase essee “Deliberate Performance” selle kohta, kuidas muuta ükskõik missugune tegevus oskusi täiendavaks harjumuseks. Vaata selle kokkuvõtet. […]
- Egnaro "Then it might be easier for her to find and pull out books she likes." -- the best thing we did for both our kids... – How A- is helping me learn how to read better
- sachac The Explosive Child (1998) had a lot of good tips on identifying difficult situations and skills that need to be developed, and No Drama Discipline... – Weekly review: Week ending April 5, 2019
- sachac Glad you liked it! =D – 2019-03-11 Emacs news
- Older »
On this day...
- 2017: Weekly review: Week ending 2017-12-15
- 2014: Connecting to previous thoughts and covering more ground
- 2012: Decision review: Art class (includes sketches)
- 2011: Emacs, artbollocks-mode.el, and writing more clearly
- 2010: More MobileOrg hacking on the Android
- 2009: Conversations with a mentor: chat about plans, mentoring, and knowledge sharing
- 2008: The Return on Mistakes
- 2008: Weekly report: Week ending Dec 14
- 2007: Gnus multi-pane tricks, or I heart Planet Emacsen
- 2007: Status report: Dec 16
- 2007: Oh, the weather outside is frightful
- 2007: Outline for task management chapter
- 2007: Weekly report
- 2007: Salmon steak with dill
- 2007: Sketchblogging with the Nintendo DS Lite
- 2007: He loves to cook
- 2007: So close!
- 2005: Friday night
- 2005: Characters blogged versus bookmarks
- 2005: The Year in Bookmarks
- 2004: YDC Festival: Puppet shows
- 2004: Refactoring Planner annotation code
- 2004: Factors for idea growth
- 2004: Updating the timelog
- 2004: Kanji for the day
- 2003: Perl for Windows administration
- 2003: Oooh, cool way to split
- 2003: Cultural differences between UNIX and Windows
- 2003: Useful Perl resources
- 2003: More stuff from visiting professor
- 2003: Perl training
- 2003: Hey, more thoughts on kara
- 2003: Moving computing into the basics
- 2003: Meeting with Dr. Juerg Nievergelt
- 2003: More about group reviews
- 2003: Recipe from [[bbdb://Aadisht][Aadisht Khanna]]
- 2003: Backlog: Fish – 2003.12.15
Meta