Add to Technorati Favorites The EDI Mapper: EDI VAN
Showing posts with label EDI VAN. Show all posts
Showing posts with label EDI VAN. Show all posts

Sunday, March 16, 2008

The Complexities of EIPP or EDI make it prime for Outsourcing

Last week I had a review of our mapping process with our lead data mapper. Ken is a man of over 20 years experience in the EDI and data mapping world. He has contributed to international EDI standards and even written a standard for the Paper industry. He knows what he is talking about. He is also a strange being who delights in the minutiae of data mapping and he enjoys nothing better than solving the problems inherent in getting one computer system to talk to another.

We were looking, as we do on a regular basis, at how we could improve the mapping process, automate more and therefore offer a better service for our customers, which of course leads to better profit. One thing we homed in on was the number of different mappings we have created for our customers and their partners.

Having looked at that number, we then looked at the number of standards available that users either are or could use. The numbers are staggering. In EDI in the UK and Europe we mainly see Tradacoms and EDIFACT. Of course there are various versions of each and in particular with EDIFACT one persons EDIFACT D96a order is not the same as another persons.

We then looked at XML, once touted as the great hope for simplifying EDI. Over 500 standards, and a lot of the standards are varied by the end user.

We then looked at ways we send and receive messages, 10 basic methods (AS2, EDI VAN, FTP, email etc) and most FTPs have slightly different requirements (e.g. do we delete the file when download or archive it) and HTTPS is different for each user we implement for.

Now we actually enjoy all this variety but we then thought about users, not our users, but users that were trying to implement EDI themselves. Don't get me wrong, we do not do anything our users could not do for themselves BUT the question is at what cost. Given the variety of message standards and comms methods around your average customer that either buys or supplies goods to and from various parties will need at least one, more likely two specialist to handle any significant EDI initiative.

If they have an IT department the skills may be present but here's the question. If you business is buying, selling, manufacturing or distributing widgets do you want your IT team spending their time trying to integrate with one of your trading partners or do you want them to concentrate on adding value to your core business activities? Integrated EDI will add to your bottom line, but not if it is diverting you and your team from your main business.

This is where the value of outsourced EDI can be found. Firstly does EDI make sense for your business. We do a simple activity based costing exercise with some of our customers to identify when EDI will add to their bottom line. Once this is done we can then look at the costs of "Do it yourself" against outsourced EDI. For any significant EDI program, outsourcing wins easily.

A friend of mine in the pub on Friday asked me why I don't do DIY at home. My answer was simple, I know what I am good at, and DIY isn't one of those things. When I did try DIY in the past I would find I would have to buy tools and materials, most of which I would never use again and then I would have to pay someone else to correct what I have done anyway, so there is no saving. The same should apply in business, do what you are good at, and leave the nasty world of EDI to someone that enjoys it, it will save you money.

Wednesday, February 13, 2008

How hard can it be to integrate two systems?

Earlier this week I was working with a particular mapping for a client. They required to send invoices to one of their customers and we were already processing the same invoices for this client from a different (Older) system. The idea was that the client was migrating from their old system to the brand new shiny system.

Not a problem one might think, as a newer system should have better abilities to trade electronically than a system well over 10 years old. We live in the modern, integrated world.

Well it turned out not to be quite that simple. First we had an email to our mapping project system to say that the new system could not produce a particular piece of data, rather it provided a piece of data that was incorrect. We found a work around for this using our facility to treat message data as look-up data and so we were able to agree how we could process the data and produce the correct information for the recipient. All a standard part of the service.

We had the software vendors file specification and we had sample data so, on we go. Then we stopped. A quick check by the mapping engine highlighted that the sample file did not match the specification. Close but no cigar.

So we requested, and were sent, two files contains not one but two specifications. We were also sent two sample files. So we now have a quandary. If we choose, we have a 50% chance of getting the wrong specification. No problem, quick chat with the client and they point to the latest specification. Couple of hours later and we have a mapping of the input data, a mapping of the output data and we can test to make sure that the documents match business rules, add up etc.

Guess what, they don't. Well if everything worked first time there would be no need for testing. We changed some of the mapping, checked the arithmetic of the data and it just did not make sense, did not have tax totals and so was basically totally invalid.

After further discussion with the customer we find the root cause of the problem. You will remember we received two specifications and two sample files. It turns out that one of the sample files, sent by the software house, had nothing to do with the final specification and between us we had contrived to choose the wrong sample. Such is Sods Law.

This is the work of data mappers, and this is not a whinge about wrong specification etc. The work of data mapping involves detailed data analysis. Yes we at least have tools that speed that process up significantly but never the less it is detailed work and we love it. After completing the mapping, in less than 8 hours including dodgy files and specification, we had a laugh with the customer, a promise of a pint owed and a happy customer.

But here's the thing. Without the tools that we have built the data analysis and mapping process would take days, in fact we have heard competitors quote large sums of money for such work, if they do not already know the file standard, and I can understand why. Some people believe there cannot be much to sending a file of invoices from one company to another, but the devil is in the detail and that is why EDI or EIPP is becoming more and more a Software as a Service arena. Without the specialist skills and tools it is the Total Cost of Ownership of EDI or EIPP, the costs of skilled data analysts, mapping tools, testing teams and support, that more and more Financial Directors are saying is too expensive to do in house. The sending and receiving of physical files is easy, but the set-up of the variety of communication processes is not. What a lot of companies are now saying is get somebody else to cope with the messy bit, we just want to send and receive one file format and use one communications method.

After all, if you distribute building materials do you want to spend your money on making the distribution more efficient and selling more OR staffing up the IT team to have data analysts, EDI experts, XML experts, communications experts, oh and have them also run you IT systems as well?

Saturday, February 02, 2008

ISO 9001 can improve your business profitability

We have recently been going through the process of achieving ISO 9000 accreditation for our Software as a Service EDI/EIPP offering. It has been a fascinating process. I had always believed that one of the secrets of a successful outsourcing or SaaS offering is to reduce the number of support calls to a minimum. I know this is a statement of the blindingly obvious but you would be amazed the tales we hear from customers moving to our service from other offerings.

When we started out on the route to ISO 9001 accreditation I thought it would have some benefit in terms of seeing where we were making mistakes, correcting them and of course there is the marketing benefit, but mainly in making sure that we continued to provide a quality service for our customers. I believe we are the only SaaS EDI or EIPP provider to be accredited for ISO 9001.

But the more I, with the help of our ISO 9001 consultant, got in to the depths of understanding ISO 9001 it became clear that whilst ISO 9001 does highlight the quality of whatever systems are being measured, the major benefit is the application of the continuous improvement principle.

We have been accredited for our data mapping processes and our systems and support processes for the provision of EDI data mapping, translation and transportation. In my next blog I will discuss the application of process to data mapping and translation, but today I want to concentrate on support.

When I look at a lot of our competitors, especially in the SaaS EDI or EIPP space, I notice that whilst the are bigger than us in terms of turnover, they are typically making huge losses. Some have accumulated losses of over 26 million and yet they still have turnover that is substantially less than their costs.

Looking at it even closer you can see that whilst they increase turnover they are increasing staff, and staff costs, much faster. To me this leads to the conclusion that whatever systems and support they have are not efficient enough. And that is one of the major benefits of the ISO9001 process.

What we have found is that every time we have have a support call/system issue the ISO process of continuous improvement has helped us to eradicate that error/issue for the future. It does not mean that we never get errors but analysis shows use that over 85% of all support calls/issue we received are outside of our service. They are either errors with the data sent to us or the comms of the sender or the recipient.

By concentrating on the ISO 9001 continuous improvement process we are able to keep our support costs to a minimum, we are able to handle millions of transactions per annum with a much smaller team than any of our competitors and we are able to keep improving the experience for our customers and their trading partners.

ISO 9001 does not make you infallible, but it helps you to learn from each mistake and improve your business and profitability.

I did have a cheeky thought though, should I go to the bigger players making all the losses and offer that we do the product, service and support for them, there will of course be an element of cost for them ;-). We could then show them how to make money instead of burning it. Just a thought....

Wednesday, January 09, 2008

A Simple Guide To Electronic Data Interchange

Over the holiday period I decided to create a "Simple" Guide to EDI for our Web Site. The idea was that, without needing to register or download, people could visit the Web Site and get a "Simple" FREE introduction to EDI, an answer to the question "What is EDI?".

I wanted to highlight to people what EDI is, what standards they can expect to find and how messages are exchanged. Six Web pages later and I have a thought. The concept of exchanging business documents electronically IS Simple.

The detail of it is convoluted, but for a good reason. Most businesses have a unique way of working. Most IT systems have a unique way of working. Certainly each industry has unique features, for example the way Paper is specified in an order is nothing like how a tin of baked beans is specified which is nothing like how a length of steel lintel for a building is specified. If a human is handling orders and invoices then their knowledge is used to "translate" between the buyers instructions and the suppliers computer system. With EDI or EIPP then the software must assume some or all of this intelligence.

The concept of EDI is easy, but as Ken Foster (One of Our Data Mappers) who has sat on many EDI committees and standards bodies says "The devil is in the detail". If people say that EDI is easy, then they are ignoring the detail or spinning a line (probably in sales ;-)). We chose to do this work because we a sad people who enjoy the detail, but it is not the standard IT software role and it is not to everyone's liking. We believe, and our customers believe, that Outsourcing EDI (SaaS) is best for most businesses because it is such a specialist area. Have a look at any "simple" Guide to EDI and if it is telling the truth you will see how complex it can be.

Sunday, December 30, 2007

The World (retail at least) Keeps Spinning

Firstly, complements of the season to all.

As with all companies in the business of EDI, at least some of our customers have continued to operate throughout the holiday season. In particular in the retail sector orders for goods to be delivered on all days are being processed, and at least one of the logistics companies that use our service were actually working from 6pm on 25th December.

Of course our servers operate on a 365 days per year basis, but certain customers require the comfort of a support contact available as well, which we provide. This is seen very much as an insurance policy and we hope it never needs to be called upon. Unfortunately this year, on 26th December it was. Not a problem with any of our servers, but because we monitor customers traffic we were able to alert a particular customer to the fact that their systems had failed and they had not sent some of the transmissions we had expected. Sometimes, because EDI is integral to a business, we can actually help users to see errors in other systems, before any other alert is raised, and it is great to be able to offer such help.

One other issue that has come to our attention is the practice of some other providers in charging for messages stored on their servers. A number of new customers this year have contacted us concerned about storage charges over the festivities. It appears that some of our competitors charge for holding messages that the customer does not download within 7 days. Whilst this does not effect users such as those detailed above, this would obviously cause extra cost for users if they are shutdown over the festive period. What an outdated practice. One would almost think that this was the equivalent of an EDI "Stealth Tax". We were able to put users minds at rest as we do not charge for storage of up to one year. Some of our users are saying this will save them several hundred pounds which is great. We want our users to be happy customers for years to come and being short sited for a few hundred pounds would be ridiculous. It would also appear to be at odds with our views that EDI should be Software as a Service and AS2 must be Free of Charge.

One day all EDI will be this way.

Friday, November 16, 2007

Some times you can process EDI too fast, Nice Problem to Have

A client rang me this week with what I believe to be a first in terms of customer requests for us. His problem was that we were processing the EDI invoices TOO FAST. I guess sometimes speed isn't everything.

This was however a genuine business problem as follows. The sender of the invoice issues the invoice upon dispatch of the goods, not an uncommon practice. Both parties are linked via our FREE AS2 service. When the invoice is issued it is placed in the AS2 outbox, received by our service, translated and sent via AS2 to the recipient. The whole process takes less than 1 minute from the time the invoice is issued, to the time it is received by the recipient. The recipient then loads the invoice in to their system (all automated) and it is immediately rejected because the goods have not been received by the warehouse. Hardly surprising because the goods have just left the loading bay at the supplier and still have hours of road time before they will arrive.

It's good to be able to have a laugh at work and the client and I found this quite amusing (maybe we're just a bit sad), but it is worth noting that no matter how efficient and fast we make the technology it still has to take the actual business practice in to account.

There are many resolutions to the problem. The first would be for the invoice issuer to delay sending the invoice until the following day. The second would be for us, as the central hub service, to stall the invoices until the following day. This was the option that was taken as our systems were easier to configure than any one Else's. The recipient could delay processing invoices until the following day as another option.

However the best solution would be for the invoice to be raised not upon dispatch, but upon receipt of an electronic Goods receipt Note (GRN), sent by the recipient of the goods when they are received in to the warehouse. This would be electronic trading haven, you could even make the invoice match the GRN, so that there would be no chance of the invoice being refused by the recipient. There is a flaw in this process though. If the recipients systems and/or the senders systems cannot process a GRN they will have to alter their ERP systems, which has a cost. It might be possible to cost justify but it is a major change of business process and proper thought must be put to the business/profit advantage to be gained. Too many times we see technologists come up with a great technology solution to a problem without thought to the true business benefit.

For these customers the simple solution worked best. We have other customers using the GRN process and they have established a huge cost reduction by doing this. Luckily with SaaS it is easy for one system to accommodate both customers, so both customers get the electronic trading that their business justifies.

Monday, November 12, 2007

"Both Parties Must Both Gain Benefits" is the First Golden Rule

You may recall that in "Beware the "cheap" option!" we looked at some of the wasteful abuses that can be imposed on you if a "website" substitute for business-to-business, integrated EDI is presented to you as the means to provide your customer with electronic documents, such as invoices, despatch and remittance advices. The "cheap" option only leads to your staff having to double type all the information from the documents into your systems and into the “website”!

  • Your work is doubled.
  • Your risks from human error are doubled.
  • Your costs go up.
  • Your profits fall.
  • Your prices need to go up...
  • You become less competitive!


What can you do to avoid such abuses?


Well, the remedy is a bit like growing asparagus...


Asparagus?


Yes. To grow asparagus you dig a hole three meters long by three meters wide about one meter deep. You fill it with all sorts of good stuff from stables mixed with exquisite soil and you plant the asparagus – FIVE YEARS AGO!


You must avoid being pushed around by the eBusiness team. They are working to a very restricted agenda. They know nothing and care less about your business value to their employer. You need to maintain and cultivate your highest levels of contact within your customer. You need your relationship to be strong enough for your senior contact to be prepared to instruct the eBusiness team to co-operate with you. To make an exception in your case. You will still be a very willing eBusiness partner, but the job is going to be done properly and, to a certain extent, on your terms!


It is best if you avoid direct contact with the eBusiness team. Let your eBusiness provider do that whilst you maintain your good standing with your senior contact(s)!


What then do you offer to do for your ally in the senior echelons of your customer?


When the “website” was implemented it was configured to receive orders from your customer's purchasing systems. These orders are passed to the “website” in electronic form. They are files and they have a format. All that has to be done is for you to be supplied with this format and for your customer to agree to sending the order files to your eBusiness system by one of the accepted transport methods.


Similarly, the “website” passes the documents (such as invoices, despatch advices and remittance advices) that are inbound for the customer's systems as files and they too have formats. If the formats are made known to you and your eBusiness provider then they too can be passed directly to the customer's systems just as efficiently as the files that are currently passed to them from the “website”.


The benefits here are that you avoid doing the work twice.


All the risks listed above are eliminated.


You have reinstated the first GOLDEN RULE:


BOTH PARTIES MUST BOTH GAIN BENEFITS!


In that same WIN-WIN vein, you are perfectly entitled to follow the example of Oliver Twist and ask for more. You are being asked to make an investment in money, time and effort to help your customer. Are you getting as much business from your customer as you could? On a number of occasions I have seen the Sales Director of a supplier use the “request” for electronic trading as a very sound reason to visit the customer and literally “ask for more”. In one instance a customer of mine, a supplier of specialist tools and devices to the construction industry, went to her customer and said something along the lines of, “We would be happy to do as you ask, but currently you only give us about ten per cent of your business. You give ninety per cent to our competitor! Give us fifty per cent and we will do all you ask and do it immediately!”


She won the extra business, increasing her company's sales to that customer by 400 per cent!


In summary so far then:


You must be informed of exactly what is required, IN FULL. It can be too late to get a decent working relationship if you fail to cultivate your senior contacts in your customer and just become part of a target list drawn up by the customer's eBusiness team or their vendor. You and your customer must get worthwhile benefits out of the eBusiness relationship. Get these things right with your customer and you have both made a good start towards successful and beneficial electronic trading.


You may even find an early opportunity to multiply your sales to this customer!


In a later blog we will consider the second GOLDEN RULE for successful integrated EDI.

Monday, October 29, 2007

Beware the "cheap" option!

A natural tendency, when asked by a customer to trade via EDI, is to put off the dreaded day for as long as possible. It is apparent that cost is involved. Who is to say that the customer will stick with you after you have spent the money to implement EDI? No wonder folks do their best to avoid it all and no wonder customers find it takes much longer than was hoped for to persuade the suppliers to trade electronically.

About the cheapest way for a customer to get correctly formatted electronic documents into their ERP system is to only have one set of integration links out to one system. To this end, cheap and freely available web technology is used to create an application that all the suppliers not taking up EDI are forced to use. Such tools are often dressed up in trendy jargon such as, “web pickup” or “zero integration”.

If you hold back on the EDI implementation you may be told to visit this “website” to find your orders, then create order acknowledgements, then despatch advices (or Advanced Shipping Notes, ASNs), and then perhaps your invoices, unless there are no invoices allowed and you have instead to find your remittance advices as part of the customer's self billing process. It seems great for the customer as all the documents to and from the website are already mapped to suit their systems.

In fact it is not all that great for the customer and it is certainly not great for you...

Your staff are expected to type it all again into your systems or copy type it into the “website”!

  • Your work is doubled.
  • Your risks from human error are doubled.
  • Your costs go up.
  • Your profits fall.
  • Your prices need to go up...
  • You become less competitive!

In truth that second bullet point is as deadly to your customer as it is to you. It leads to increased costs for your customer every time they get into the paper chases and escalations that always result during any remedial activities.

What to do?

Well don’t run a mile when you get asked to trade via EDI. Get the EDI integrated with your system so it runs automatically. Use a service that shines forth with efficiency and prompt attention for your customer. Stand out from the crowd and you will have a good chance of avoiding a dictated “solution” that may save you the price of a proper EDI implementation but will cost you much more in extra work and inevitable human error.

EDI, The ultimate Software as a Service

There are now more and more applications that are available as Software as a Service (SaaS). The highest profile is Salesforce.com, which we use internally for CRM, Customer Support and Project Management. We have partnered with another SaaS offering in Netsuite, which offers a complete ERP as SaaS, and we also use Google Docs for sharing Spreadsheets and Text Documents.

However, one of the very best applications that SaaS can be used for is EDI. The way EDI is moving at present with multiple standards (EDI, XML and Flat File) and multiple communication methods such as EDI VAN and AS2, it makes sense to outsource the technical complexity to a company that specialises in it. Whilst the importance of EDI as a way in increasing both profits and cash flow for your business are undeniable, it would be rare for the technical complexity to be a core business for any organisation other than an EDI specialist.

Since we started making our software available as SaaS in 2003, all our customers have moved to this model. They all share the same benefits of a single method of communications (to suit their requirements) and a single file format (which suits their ERP). On our customers behalf we currently have in excess of 800 different message translations and 17 different communication methodologies. Whilst some IT teams in large organisations may see this as "their territory", I am sure that the directors do not see it as core competency for the business, and would rather see them developing inventive uses for IT that affect their core business, whatever it might be.

SaaS is a growing market, even Microsoft are looking at planning to enter the market, and EDI SaaS is a natural fit.

Tuesday, October 16, 2007

Why is the Internet not Free?

When companies started using EDI to exchange their business messages (way back in the days of punched card) they needed a way to send the messages to each other. This method needed to be both secure and reliable and from this rose the EDI Value Added Network (VAN).

A number of IT Network companies around the world, normally in conjunction with a telecoms operation, set-up dedicated networks that could carry your business data to any part of the world as long as the recipient had an EDI mailbox. It did not matter if that person used the same EDI VAN as the sender, the networks could communicate and so messages could be reliably exchanged. Obviously the EDI VAN would charge for this service as you were using their network capacity and their servers.

Then along comes the Internet. Over time the Internet has been able to connect any computer to any other computer and this has opened up the opportunity to replace the EDI VAN with other methods of sending and receiving data. The advantage being that as long as the communications method used was an Internet standard, you would not need a specialised piece of software (as you did to communicate with an EDI VAN) and so you could send the messages for Free. So we now see people sending EDI messages using email, FTP, FTPS, SFTP, HTTP, HTTPS, SSH and AS2.

But hang on a minute, whilst you can use all the other methods for free, and no one will object, some people are trying to charge for AS2, and sometimes a hefty premium. I just don't get it. AS2 stands for Applicability Statement 2 and is a WC3 published Internet standard. Therefore we should have the choice to buy it or write it. As long as it conforms to the WC3 standard, all AS2 servers should talk to each other. But this is not what we sometimes hear.

We hear Fear, Uncertainty and Doubt (FUD) stories that you have to have each version of a given server tested with each version of another server and if all the various server products in existence have not been tested with each other then you cannot guarantee that they will work. When is a standard not a standard? I think this is arrant nonsense, dreamt up to enable people to charge for something that should be free.

Luckily the Open Source community sees through this and there are a number of Open Source AS2 servers available. We use the server from Open AS2 and have used it to establish hundreds of AS2 connections, with the vast majority of the "charged for" servers. In fact, if the last statement is true, we have done the testing that most people charge for. We have had one failure for Open AS2, but when we delved in to it we discovered that the large organisation involved had not conformed to the AS2 standard and that no one had connected a vanilla AS2 server to theirs anyway.

We are firm believers in the value of AS2 for sending business messages via the Internet, we just believe it should not be charged for. We now deploy it Free of Charge for our customers and their Trading Partners should they wish to use it. It reduces the costs of Electronic Message Exchange, greatly enhances the speed of message delivery and provides the most secure and reliable method for exchanging business messages. It's certainly better than the Postal Service :-)

Have a look at Open AS2 today. It could save you time and money.

Friday, October 12, 2007

Got EDI working? Now everyone gets fired?

Of course not! Yes EDI and all variations of it, when integrated to your systems and running automatically, will be cheaper than people. But you won't be getting rid of them. What a waste that would be! Your company IS the people within it. They are the key to your success in the past, your success right now and your success into the future.

Being a somewhat older person I am old enough to remember when companies ran their businesses without any computers at all. Everything was written down and a good head for figures, or nimble fingers for the comptometer, or add listing machine, were important desiderata.

Along came the first computers. Knees trembled. Fears mounted. What will we all do? We are to be replaced by a machine!

Our fears were unfounded. All that happened was that businesses grew without adding more folk to look after all the extra administration work. In other words we got more productive and were able to concentrate our time on work best suited for human beings than for machines like computers.

EDI, and all the other methods of integrated, automatic, electronic trading, led to the same number of people being able to handle more work. EDI takes care of the input and output of information. The people simply use the information (information that just so happens now to be more accurate and more quickly obtained than in the old days of manually copy typing everything) and so the business grows again...

Imagine a supermarket chain without electronic trading to link to its suppliers! The sheer volume of copy typing to raise orders couldn't be managed even with aircraft hangars full of people clacking away at keyboards. The shelves would have a few hundred product choices to try and satisfy hungry patrons ("consumer" is such a dismal name that implies squandering and questions like "Who ate all the pies? So let's call ourselves "patrons"). Today there are thousands of product choices in hundreds of supermarket branches, all over the country and it's all thanks to EDI.