After reading a post on here, I've been inspired to build an application myself. However, I'm struggling to think of the ideal design for it. The application will be written purely in Java.
The application consists of three parts:
1) A Spring MVC web based front-end
2) A selenium based web scraper that will be run every 5 hours or so
3) A database to store the data the web scraper retrieves
So I figured that these 3 different parts should be hosted on 3 different servers ultimately. However, I then realised that the web front-end will need to connect to the database and so will the web scraper. In that case I will want the model part of MVC and the objects created in the web scraper to be the same. I guess in that case what I am after is some sort of shared model between the web scraper and the web front-end.
Any help with the best possible design for this?
The application consists of three parts:
1) A Spring MVC web based front-end
2) A selenium based web scraper that will be run every 5 hours or so
3) A database to store the data the web scraper retrieves
So I figured that these 3 different parts should be hosted on 3 different servers ultimately. However, I then realised that the web front-end will need to connect to the database and so will the web scraper. In that case I will want the model part of MVC and the objects created in the web scraper to be the same. I guess in that case what I am after is some sort of shared model between the web scraper and the web front-end.
Any help with the best possible design for this?