Yesterday, I tried upgrading WordPress to the latest version. After upgrading, I noticed that I can no longer add new posts in my blog using the new editor, Gutenburg. I was getting this error instead:Continue reading Solved: TypeError: Cannot read property ‘show_ui’ of undefined
For the past three (3) years, I’ve worked on multiple Scrapy projects with lots of spiders. Most of them are scheduled via scrapyd, a JSON API to schedule spiders. Sometimes, this spiders go kaput for various reasons such as change in layout, change in URL, being blacklist, among others. Checking the logs for them one-by-one can be time-consuming – so here’s where Rollbar comes in.
Rollbar is an error monitoring service that groups similar errors and gives you insights which one occurs the most. It can even help you track which commit/versin introduced the bugs. This way, you can discover bugs faster making it quicker for you to fix them.
Installing Rollbar for Python
Fortunately, there’s pyrollbar. You can install it via pip:
pip install pyrollbar
Integration pyrollbar to your Scrapy spider
Then, on your base spider (the spider that your rest of your spiders will extend, hook an instance of the
RollbarHandler to the loggers of
twisted, and the spider itself.
import logging from scrapy import Spider from rollbar.logger import RollbarHandler class BaseSpider(Spider): name = 'base_spider' # I will be overwritten anyway def __init__(self, *args, **kwargs): handler = RollbarHandler(access_token=
, environment= , level=logging.ERROR) logging.getLogger('scrapy').addHandler(handler) logging.getLogger('twisted').addHandler(handler) self.logger.logger.addHandler(handler)
MRT3 has been all over the news lately, from the long queues, not enough trains to accommodate the riding public, the extortion scandal exposed by a diplomat – among others. Unfortunately, most, if not all of them are bad news.
That’s what made me think on what app to build to help the riding public. I tried to brainstorm. First thing to do was to do an inventory of data available to me. Unfortunately, it’s next to none. The only thing that I found was the CCTV live footage from the stations. Continue reading MRT3 website, hacked by AnonymousPH?