Thanks Barry. Back on topic - I should get the MSD back today. If it fails again I'll buy something else. I'm thinking about a Duraspark from Faron Rhoads.
I forgot to mention Thailand, I worked there too. Interesting cultural clash. We were hired as consultants to figure out why the exchange trading system was losing orders between the broker's systems and the exchange. Their IT team was made up of a mid 30's guy as manager and a group of young women. We had them walk us through the architecture of their system, in particular how they constructed their messaging system that passed orders and other information between systems.
They told us it was based on UDP (User Datagram Protocol) rather than TCP (Transmission Control Protocol) for their transmission protocol. UDP is akin to a radio station broadcasting a signal. They don't know who is getting the signal and don't really care. A lost message is assumed to be no big deal. TCP/IP is what is used in most computer systems, and it has methods to ensure that messages are delivered or the sending system is informed so it can re-send.
If you use UDP it is up to the system designer to add in a method to ensure delivery. This is usually done by putting sequence numbers in the messages so you can tell if one was dropped, add an acknowledgement feature so the sending system gets confirmation, and you need a heart beat to tell you the system is still up or you could lose messages and not know. It can be done, but generally it is better to just use TCP.
We asked if they had built a transmission guarantee layer, and the looked confused. They had paid us to fly to Bangkok since we were among the world leading experts in this type of technology. We had scheduled 3 days to work on the problem, and it was 9 am on the first day and we said - "We know what your problem is".
They were so upset over the loss of face (took us three questions to find the problem) that they would never speak to us again. We got paid and had two days in Bangkok to sightsee.
As you might imagine, over the last 30 years I haven't had a lot of weekends at home, explains why it took me until I was in my late 50's to build my first FE.