I mostly do Data/Web Scraping/Mining using Python Scrappy. But also have worked with Python BeautifulSoup, Python Selenium. I develop apps/scripts which can be scheduled at regular intervals and can update Database automatically. I have a CMS that is built in Codeigniter which I can integrate into the scraper I develop, you can manage the scraped data using a nice User Interface.