So I’ve had this idea on my mind for a surprisingly long time, maybe even a couple of years. Finally I’m acting on it.
I have over the years seen a lot of EMR SYSTEMS, healthcare integration platforms tools applications both off the shelf vendor products and in house solutions. Most fall in the category I would call legacy (older technologies) or at best current proven technologies. Not much out there that is more bolder in using some of the newer specific big data solutions. That’s understandable since in some cases if the existing solution is not broke, why fix it.
Still this has left me with an itch that I’m going to try address here. I want to see a data integration project that aggregates healthcare data (hl7, custom flat files, x12,….), uses a big data platform to ingest, monitor, transform, store and run some analytics – the whole 9 yards.
If I’m successful in my next few posts I will set up a simple project to do so, using simple use cases at each of the integration steps I have mentioned above.
Down to some specifics:
I plan to use the following technologies: (if I could getaway with it I’d use spring xd solely)
- Source of some test data – mirth for hl7, spring xd for other generic data sources, others as my use cases advance
- Ingestion of data – camel for hl7, spring xd
- Monitoring – spring xd counters and gauges
- Transformation – spring xd processors, sources and sinks
- Persistence – hdfs using spring xd
- Analytics -not sure yet; one of the solutions supported by spring xd
My infrastructure consists of Amazon web services ec2 instances (Ubuntu) that I will spin up as required.
In the next post, I will have a short write up about how I got set up with aws ec2 and installed mirth and got started with eclipse
kodesnippetsnstuff 