通过URL接口定时读取其返回的xml(可存入数据库)
之前都是直接读取xml文件的,可是这次做东西对方只提供一个URL返回xml,我需要定时读取。
解决方案:
1:通过URL和URLConnection来解析改URL,使其返回inputstream
2:用dom4j解析该inputstream,将解析的数据封装成需要的对象,来存入一个List或Map
3:定义一个Controller来执行该过程
4:用crontab来执行定时任务(linux下,执行crontab-e进行编辑)
@Get("/load") public String loadDataFromXmlByDate(Invocation inv, @Param("begin") Date datebegin, @Param("end") Date dateend) { String begin = DateTimeUtil.getFormatDateTime(datebegin, "yyyyMMdd"); String end = DateTimeUtil.getFormatDateTime(dateend, "yyyyMMdd"); // String ip = inv.getRequest().getRemoteAddr(); String URL = WbConstant.URL + WbConstant.URL_DATE_BEGIN + begin + WbConstant.URL_DATE_END + end; List<Statistic> stats = parseXML(URL); for (int i = 0; i < stats.size(); i++) { Statistic st = stats.get(i); st.setTime(datebegin); //通过service层来执行逻辑并存储到DB IResult result = dataService.createStatistic(st); if (result.isSuccess()) { if (logger.isInfoEnabled()) { logger.info("insert data into db from xml success"); } } else { if (logger.isInfoEnabled()) { logger.info(result.getResult("error").toString()); } } } return "ok"; } /** * 加载默认日期的xml * @param inv * @return */ @Get("/loadDefault") public String defaultLoadDateFromXml(Invocation inv) { Date today = new Date(); Calendar cal = Calendar.getInstance(); cal.add(Calendar.DATE, -1); Date yesterday = cal.getTime(); return loadDataFromXmlByDate(inv, yesterday, today); } private List<Statistic> parseXML(String URL) { long beginTime = System.currentTimeMillis(); List<Statistic> xmlList = new ArrayList<Statistic>(); SAXReader reader = new SAXReader(); URL url = null; try { url = new URL(URL); } catch (MalformedURLException e) { logger.error("给定的URL生成错误", e); } try { URLConnection urlConnection = url.openConnection(); InputStream urlIn = urlConnection.getInputStream(); doc = reader.read(urlIn); } catch (IOException e) { logger.error("IOException:通过URL-openConnection-getInputStream时,错误", e); } catch (DocumentException e) { logger.error("DocumentExcepion:SAXReader解析inputsream为Document时,错误", e); } Element root = doc.getRootElement(); for (Iterator<Element> it = root.elementIterator(); it.hasNext();) { Element e = (Element) it.next(); String date = e.elementText("date"); String pid = e.elementText("pid"); String data = e.elementText("data"); //封装数据为对象 Statistic stat = new Statistic(); stat.setHomeCount(Integer.parseInt(data)); stat.setPid(pid); stat.setTime(DateTimeUtil.getFormatDate(date)); xmlList.add(stat); } long endTime = System.currentTimeMillis(); System.out.println("共花费时间为" + (endTime - beginTime) + "ms"); return xmlList; }
上面的controller写完了,就可以用crontab来执行定时任务了,该controllerURL为,xxx.com/loadDefault则,定为每天下午2点钟执行一次如下
0014***wget-a/data/logs/wb/xml.loghttp://xxx.com/loadDefault
OK了,可以了
相关推荐
与卿画眉共浮生 2020-10-14
xiyang 2020-08-21
baijinswpu 2020-07-29
leonranri 2020-07-26
zhongliwen 2020-07-05
麋鹿麋鹿迷了路 2020-07-05
zengyu00 2020-07-05
XGQ 2020-07-04
CoderBoy 2020-06-28
whbing 2020-06-28
绝望的乐园 2020-06-27
wellfly 2020-06-26
菇星獨行 2020-06-25
草原孤狼 2020-06-25
坚持着执着 2020-06-16
wcqwcq 2020-06-14
yuanye0 2020-06-14
zhongliwen 2020-06-13
MrFuWen 2020-06-09