Viewing posts by lee

Launch AIrVPN without password prompt in linux

AirVPN is a great VPN service that works on many platforms including linux. If you are using their client on linux, you may have found yourself annoyed having to enter your admin password each time you launch the client. There is a way to get around this in linux.

Read more

Adapting Scrapy's images pipeline to use Azure Storage

Although it's not documented, the Scrapy images pipeline supports storing your downloaded images in an Amazon S3 bucket. This is very useful especially when scraping is over distributed nodes and you want a centralized image store.

Read more

How does Scrapy react to a blocked pipeline?

These are just some notes on how Scrapy reacts to a blocked pipeline.

Read more

Local mail on linux with sendmail

Chances are that you don't want to turn your personal laptop into a full blown mailserver, however it is very important to set up a local only mailserver in linux. This allows you to receive errors from failed cronjobs along with other processes, and also is handy for development ...

Read more

Crashplan and encrypted home directories on linux

Crashplan loads through a Sys-V-Init script in /etc/init.d/crashplan configured by default to start on runlevels 2, 3, 4 and 5. This means Crashplan loads on boot before the user has logged in, and crucially with an encrypted home dir, before the dir has been unencrypted or mounted ...

Read more