GEN have invested significantly in our Data Processing facilities and currently have two core database processing clusters, one using Microsoft SQL Server 2014 and one based on MariaDB AX and CLusterIX.
The scale of the processing power allows us to process vast amounts of data quickly returning results from data cubes and data lakes in seconds instead of hours. Leveraging this huge computing power allows us to take on subcontracted Data Processing from companies who want one time or multi time processing. Further to this we have locally stored global datasources for key data allowing us to validate, cross process and reconcile customer data with industry standard data sources.
Our Local Data Sources
UK Post Code Data:The UK Post Code Database gives us data on every street in the country including but not limited to its map location, number of properties, business or residential, District, Ward and Locality Data. Routes and Distances and County/City Council Zoning. From this data we have grid references and co-ordinates for every street in the UK with various postcode formats.
UK Demographic Data: With the data from Cameo we can, by postcode or locality determine demographic such as average house price, affluence, property types, as well as classifications of people within those zones such as working, non-working, retired, and ethnicity & language data.
UK Census Data: The Census gives us reasonably reliable data per household such as number of members, ethnicity, languages, religion, as well as employment status and zoning data.
UK Companies Data: Every limited company in the UK is available together with Directors information and SIC Codes.
UK Telephony Data: CLI to Exchange and Provider data as well as broadband and service availability by postcode or CLI and in many cases current broadband and telephony provider. We also have some data on SIP customers, coverage etc.
UK Financial Data: Affluence, Debt, Finance and Income data by Street, Locality or Area is available to give detailed spend and debt statistics by street. Knowing who your customers are, what they spend and receive and how likely they are to consider your product or service can make all the difference.
Email and Address Data: We have around 7 million email addresses most of which are linked to property addresses and whilst we can't and won't sell these details we can use them to validate your lists against locality, provider, household and more.
Combining these datasets allows us to progressively focus processing on the specific needs of the customer. A typical example would be a customer with a calling list which we can process against our Postcode, Demographic and Census data to grade customers based on their likelihood of purchasing a particular offering or indeed their need of a particular offering. Another example would be to wash a customers data returning only those records where sales are possible or likely. Validation of email lists, customer data, homemovers and so on is all possible.
Specialist Processing
In the past we've taken on some challenging processes including facial recognition from 960 hours of Video against a database of employees, Linking a list of 14 million email addresses back to full addresses and then adding average indebtedness, Identifying specific broadband availability by postcode and house number, Leveraging Mapping data to match GPS data streams to a specific street and many more. The harder it is to do the more we like it!
We take on data processing on a case by case basis and have strict controls in place to ensure information is tightly controlled both in and out of the system. Automated processing can be setup using FTP data transfer to receive data, process it and return it via the same method which allows companies to repeat processing daily, weekly or whenever needed ensuring up-to-date data.
If you have a big data project and would like to discuss how we can help then contact us today!