Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (Cyborg)
  • No Skin
Collapse
Brand Logo

CIRCLE WITH A DOT

  1. Home
  2. Uncategorized
  3. What a lot of people do not understand is the fragility of supply chains.

What a lot of people do not understand is the fragility of supply chains.

Scheduled Pinned Locked Moved Uncategorized
57 Posts 41 Posters 292 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • raymaccarthy@mastodon.ieR This user is from outside of this forum
    raymaccarthy@mastodon.ieR This user is from outside of this forum
    raymaccarthy@mastodon.ie
    wrote last edited by
    #31

    @rcosta @eckes @jt_rebelo @masek

    Any link not solvable is a disaster. That's the point.

    It's more common than people imagine and sometimes the reason for a product sold out and 2 years later no replacement. Then later the supposedly replacement product is inferior, or never appears.

    See Kobo Sage 8″ ereader.
    Yaesu attempted to replace FT817ND with FT818ND, but had to cease that too due to lack of parts.

    There are many more examples of inferior or no product replacement. It will get common.

    1 Reply Last reply
    0
    • raymaccarthy@mastodon.ieR This user is from outside of this forum
      raymaccarthy@mastodon.ieR This user is from outside of this forum
      raymaccarthy@mastodon.ie
      wrote last edited by
      #32

      @rcosta @eckes @jt_rebelo @masek
      Really big companies don't care as they are marketing a brand.

      1 Reply Last reply
      0
      • masek@infosec.exchangeM masek@infosec.exchange

        What a lot of people do not understand is the fragility of supply chains.

        Setup

        Let us assume there is a part X that is used by a large number of other companies. It is not glamorous, it is not expensive, and nobody outside a small circle of specialists ever thinks about it. But it is needed. Without it, other products cannot be finished.

        Everything is fine

        Part X is made by a small company with a few dozen employees and a machine that is several decades old.

        Everything runs smoothly. The company knows how to maintain the machine. They know how to operate it. They know its strange noises, its moods, its undocumented rituals. They know which lever needs a bit of persuasion on cold mornings and which replacement part must be machined by hand because nobody has made the original since 1987. They also know how to train new employees, because the knowledge still exists inside the company.

        Crisis

        Then, suddenly, a few large customers run into a crisis.

        Orders slow down. The warehouses fill up with part X. Prices fall.

        The company downsizes. Then it downsizes again. But nobody really notices, because stocks are still full. Customers are not yet affected. Purchasing departments can still get part X from inventory. Balance sheets still look fine. The problem has not yet reached the spreadsheet.

        If this goes on for long enough, the company goes broke.

        Again, nobody really notices. Stocks are still full. Some people may worry, but as long as no current production line is stopping and no quarterly number is visibly bleeding, nothing urgent is done.

        The employees move on. They retire, change industries, start new careers. The old machine is sold for scrap. The building is repurposed. The knowledge evaporates.

        Recovery

        A few years later, demand picks up again.

        The warehouses slowly empty. Stocks run low. People start ordering part X again, only to discover that nobody is offering it anymore.

        Now someone decides to restart production.

        The first thing they discover is that there is no machine. Building a new one would be prohibitively expensive, assuming anyone still knows how to build it properly. So they desperately search for an old one.

        They get lucky. In a scrapyard, they find a machine that used to produce part X. It is rusted, incomplete, and dysfunctional. Naturally, they buy it.

        Now they try to get it working again.

        But there is another problem. There are no people left who know how to maintain it. So they hire someone who understands industrial maintenance in general, but has never worked on this specific machine. That person does their best. They improvise. They read old manuals. They reverse-engineer undocumented fixes. They keep the machine alive with skill, patience, and increasing amounts of despair.

        But it breaks down every few hours. Output is abysmal.

        Bottlenecks

        And now that one poor maintenance person is overworked. They need help. But training help requires time, and the only person who can train others is the same person needed to keep the machine barely running. Every hour spent teaching is an hour not spent preventing the next failure.

        Very few businesses survive this phase.

        There is no institutional knowledge anymore. New people are hired, begin training, look at the state of the machine, the chaos of the process, and the constant emergency mode, and conclude that the business is doomed anyway. Then they quit.

        Churn becomes terrible. Even if the company survives financially, it remains fragile. It is always just one or two people quitting away from disaster.

        At the end the world decides it needs to get rid of part X as the supply is too fragile.

        Summary

        This is still very much simplified. The reality is more complex, more ugly.

        And that is the part many people miss: a supply chain is not just warehouses, contracts, prices, and transport routes. It is also people, habits, obsolete machines, informal knowledge, and boring little skills that nobody values until they are gone.

        peachfront@toot.communityP This user is from outside of this forum
        peachfront@toot.communityP This user is from outside of this forum
        peachfront@toot.community
        wrote last edited by
        #33

        @masek

        too true

        hubby is in industrial scales & is in charge of knowing what & how to implement part X for multiple factories in multiple industries... when he nearly died, they finally woke up to the fact he might need an apprentice

        who cares if Atlas shrugs but once the scales are no longer accurate, nothing works & things mixed wrongly in factories blow up...

        1 Reply Last reply
        0
        • masek@infosec.exchangeM masek@infosec.exchange

          What a lot of people do not understand is the fragility of supply chains.

          Setup

          Let us assume there is a part X that is used by a large number of other companies. It is not glamorous, it is not expensive, and nobody outside a small circle of specialists ever thinks about it. But it is needed. Without it, other products cannot be finished.

          Everything is fine

          Part X is made by a small company with a few dozen employees and a machine that is several decades old.

          Everything runs smoothly. The company knows how to maintain the machine. They know how to operate it. They know its strange noises, its moods, its undocumented rituals. They know which lever needs a bit of persuasion on cold mornings and which replacement part must be machined by hand because nobody has made the original since 1987. They also know how to train new employees, because the knowledge still exists inside the company.

          Crisis

          Then, suddenly, a few large customers run into a crisis.

          Orders slow down. The warehouses fill up with part X. Prices fall.

          The company downsizes. Then it downsizes again. But nobody really notices, because stocks are still full. Customers are not yet affected. Purchasing departments can still get part X from inventory. Balance sheets still look fine. The problem has not yet reached the spreadsheet.

          If this goes on for long enough, the company goes broke.

          Again, nobody really notices. Stocks are still full. Some people may worry, but as long as no current production line is stopping and no quarterly number is visibly bleeding, nothing urgent is done.

          The employees move on. They retire, change industries, start new careers. The old machine is sold for scrap. The building is repurposed. The knowledge evaporates.

          Recovery

          A few years later, demand picks up again.

          The warehouses slowly empty. Stocks run low. People start ordering part X again, only to discover that nobody is offering it anymore.

          Now someone decides to restart production.

          The first thing they discover is that there is no machine. Building a new one would be prohibitively expensive, assuming anyone still knows how to build it properly. So they desperately search for an old one.

          They get lucky. In a scrapyard, they find a machine that used to produce part X. It is rusted, incomplete, and dysfunctional. Naturally, they buy it.

          Now they try to get it working again.

          But there is another problem. There are no people left who know how to maintain it. So they hire someone who understands industrial maintenance in general, but has never worked on this specific machine. That person does their best. They improvise. They read old manuals. They reverse-engineer undocumented fixes. They keep the machine alive with skill, patience, and increasing amounts of despair.

          But it breaks down every few hours. Output is abysmal.

          Bottlenecks

          And now that one poor maintenance person is overworked. They need help. But training help requires time, and the only person who can train others is the same person needed to keep the machine barely running. Every hour spent teaching is an hour not spent preventing the next failure.

          Very few businesses survive this phase.

          There is no institutional knowledge anymore. New people are hired, begin training, look at the state of the machine, the chaos of the process, and the constant emergency mode, and conclude that the business is doomed anyway. Then they quit.

          Churn becomes terrible. Even if the company survives financially, it remains fragile. It is always just one or two people quitting away from disaster.

          At the end the world decides it needs to get rid of part X as the supply is too fragile.

          Summary

          This is still very much simplified. The reality is more complex, more ugly.

          And that is the part many people miss: a supply chain is not just warehouses, contracts, prices, and transport routes. It is also people, habits, obsolete machines, informal knowledge, and boring little skills that nobody values until they are gone.

          catha@masto.esC This user is from outside of this forum
          catha@masto.esC This user is from outside of this forum
          catha@masto.es
          wrote last edited by
          #34

          @masek I've experienced that... HQ woke up after I left but then they had to invest a lot to get ilthe whole company working again and as wel in damage control.

          1 Reply Last reply
          0
          • S stinson_108@mastodon.social

            @masek

            As long as sea lanes remain open, #tariffs stable, and no currency restrictions, the market will figure out the proper complexity of supply chains. Pandemics and ships sideways in the #Suez can be overcome. Like everything else, it's the idiocy of our leaders we should fear.

            catha@masto.esC This user is from outside of this forum
            catha@masto.esC This user is from outside of this forum
            catha@masto.es
            wrote last edited by
            #35

            @Stinson_108
            No. I've seen this happen in the company I worked for until 2012. Back then there was no problem with shipping lines, tarrifs, etc.
            It took them a few years and a lot of money to restore damage. Knowledge AND image...

            1 Reply Last reply
            0
            • masek@infosec.exchangeM masek@infosec.exchange

              What a lot of people do not understand is the fragility of supply chains.

              Setup

              Let us assume there is a part X that is used by a large number of other companies. It is not glamorous, it is not expensive, and nobody outside a small circle of specialists ever thinks about it. But it is needed. Without it, other products cannot be finished.

              Everything is fine

              Part X is made by a small company with a few dozen employees and a machine that is several decades old.

              Everything runs smoothly. The company knows how to maintain the machine. They know how to operate it. They know its strange noises, its moods, its undocumented rituals. They know which lever needs a bit of persuasion on cold mornings and which replacement part must be machined by hand because nobody has made the original since 1987. They also know how to train new employees, because the knowledge still exists inside the company.

              Crisis

              Then, suddenly, a few large customers run into a crisis.

              Orders slow down. The warehouses fill up with part X. Prices fall.

              The company downsizes. Then it downsizes again. But nobody really notices, because stocks are still full. Customers are not yet affected. Purchasing departments can still get part X from inventory. Balance sheets still look fine. The problem has not yet reached the spreadsheet.

              If this goes on for long enough, the company goes broke.

              Again, nobody really notices. Stocks are still full. Some people may worry, but as long as no current production line is stopping and no quarterly number is visibly bleeding, nothing urgent is done.

              The employees move on. They retire, change industries, start new careers. The old machine is sold for scrap. The building is repurposed. The knowledge evaporates.

              Recovery

              A few years later, demand picks up again.

              The warehouses slowly empty. Stocks run low. People start ordering part X again, only to discover that nobody is offering it anymore.

              Now someone decides to restart production.

              The first thing they discover is that there is no machine. Building a new one would be prohibitively expensive, assuming anyone still knows how to build it properly. So they desperately search for an old one.

              They get lucky. In a scrapyard, they find a machine that used to produce part X. It is rusted, incomplete, and dysfunctional. Naturally, they buy it.

              Now they try to get it working again.

              But there is another problem. There are no people left who know how to maintain it. So they hire someone who understands industrial maintenance in general, but has never worked on this specific machine. That person does their best. They improvise. They read old manuals. They reverse-engineer undocumented fixes. They keep the machine alive with skill, patience, and increasing amounts of despair.

              But it breaks down every few hours. Output is abysmal.

              Bottlenecks

              And now that one poor maintenance person is overworked. They need help. But training help requires time, and the only person who can train others is the same person needed to keep the machine barely running. Every hour spent teaching is an hour not spent preventing the next failure.

              Very few businesses survive this phase.

              There is no institutional knowledge anymore. New people are hired, begin training, look at the state of the machine, the chaos of the process, and the constant emergency mode, and conclude that the business is doomed anyway. Then they quit.

              Churn becomes terrible. Even if the company survives financially, it remains fragile. It is always just one or two people quitting away from disaster.

              At the end the world decides it needs to get rid of part X as the supply is too fragile.

              Summary

              This is still very much simplified. The reality is more complex, more ugly.

              And that is the part many people miss: a supply chain is not just warehouses, contracts, prices, and transport routes. It is also people, habits, obsolete machines, informal knowledge, and boring little skills that nobody values until they are gone.

              killick@dmv.communityK This user is from outside of this forum
              killick@dmv.communityK This user is from outside of this forum
              killick@dmv.community
              wrote last edited by
              #36

              @masek

              My brother works in a jewelry factory-- there is no crisis if they stop making a particular item, but they do employ loads of skilled employees - machinists, polishers, etc. Over the years he's frequently had to explain why it's a bad idea to lay off these people during down times. Skilled polishers save you money. Skilled machinists save you money.

              1 Reply Last reply
              0
              • masek@infosec.exchangeM masek@infosec.exchange

                What a lot of people do not understand is the fragility of supply chains.

                Setup

                Let us assume there is a part X that is used by a large number of other companies. It is not glamorous, it is not expensive, and nobody outside a small circle of specialists ever thinks about it. But it is needed. Without it, other products cannot be finished.

                Everything is fine

                Part X is made by a small company with a few dozen employees and a machine that is several decades old.

                Everything runs smoothly. The company knows how to maintain the machine. They know how to operate it. They know its strange noises, its moods, its undocumented rituals. They know which lever needs a bit of persuasion on cold mornings and which replacement part must be machined by hand because nobody has made the original since 1987. They also know how to train new employees, because the knowledge still exists inside the company.

                Crisis

                Then, suddenly, a few large customers run into a crisis.

                Orders slow down. The warehouses fill up with part X. Prices fall.

                The company downsizes. Then it downsizes again. But nobody really notices, because stocks are still full. Customers are not yet affected. Purchasing departments can still get part X from inventory. Balance sheets still look fine. The problem has not yet reached the spreadsheet.

                If this goes on for long enough, the company goes broke.

                Again, nobody really notices. Stocks are still full. Some people may worry, but as long as no current production line is stopping and no quarterly number is visibly bleeding, nothing urgent is done.

                The employees move on. They retire, change industries, start new careers. The old machine is sold for scrap. The building is repurposed. The knowledge evaporates.

                Recovery

                A few years later, demand picks up again.

                The warehouses slowly empty. Stocks run low. People start ordering part X again, only to discover that nobody is offering it anymore.

                Now someone decides to restart production.

                The first thing they discover is that there is no machine. Building a new one would be prohibitively expensive, assuming anyone still knows how to build it properly. So they desperately search for an old one.

                They get lucky. In a scrapyard, they find a machine that used to produce part X. It is rusted, incomplete, and dysfunctional. Naturally, they buy it.

                Now they try to get it working again.

                But there is another problem. There are no people left who know how to maintain it. So they hire someone who understands industrial maintenance in general, but has never worked on this specific machine. That person does their best. They improvise. They read old manuals. They reverse-engineer undocumented fixes. They keep the machine alive with skill, patience, and increasing amounts of despair.

                But it breaks down every few hours. Output is abysmal.

                Bottlenecks

                And now that one poor maintenance person is overworked. They need help. But training help requires time, and the only person who can train others is the same person needed to keep the machine barely running. Every hour spent teaching is an hour not spent preventing the next failure.

                Very few businesses survive this phase.

                There is no institutional knowledge anymore. New people are hired, begin training, look at the state of the machine, the chaos of the process, and the constant emergency mode, and conclude that the business is doomed anyway. Then they quit.

                Churn becomes terrible. Even if the company survives financially, it remains fragile. It is always just one or two people quitting away from disaster.

                At the end the world decides it needs to get rid of part X as the supply is too fragile.

                Summary

                This is still very much simplified. The reality is more complex, more ugly.

                And that is the part many people miss: a supply chain is not just warehouses, contracts, prices, and transport routes. It is also people, habits, obsolete machines, informal knowledge, and boring little skills that nobody values until they are gone.

                unchartedworlds@scicomm.xyzU This user is from outside of this forum
                unchartedworlds@scicomm.xyzU This user is from outside of this forum
                unchartedworlds@scicomm.xyz
                wrote last edited by
                #37

                @masek

                Excellent post - thank you.

                1 Reply Last reply
                0
                • raymaccarthy@mastodon.ieR This user is from outside of this forum
                  raymaccarthy@mastodon.ieR This user is from outside of this forum
                  raymaccarthy@mastodon.ie
                  wrote last edited by
                  #38

                  @rcosta @eckes @jt_rebelo @masek
                  That's a rare example of 3D printing to the rescue. Helped due to low volume.

                  No, it's not primarily environmental. It's lack of investment in training, lack of open source documentation (or even any under NDA) and lack of second sources.

                  Yes, building to last, repair and reuse are important. But only tangential to supply chain risks.

                  rcosta@archaeo.socialR 1 Reply Last reply
                  0
                  • masek@infosec.exchangeM masek@infosec.exchange

                    What a lot of people do not understand is the fragility of supply chains.

                    Setup

                    Let us assume there is a part X that is used by a large number of other companies. It is not glamorous, it is not expensive, and nobody outside a small circle of specialists ever thinks about it. But it is needed. Without it, other products cannot be finished.

                    Everything is fine

                    Part X is made by a small company with a few dozen employees and a machine that is several decades old.

                    Everything runs smoothly. The company knows how to maintain the machine. They know how to operate it. They know its strange noises, its moods, its undocumented rituals. They know which lever needs a bit of persuasion on cold mornings and which replacement part must be machined by hand because nobody has made the original since 1987. They also know how to train new employees, because the knowledge still exists inside the company.

                    Crisis

                    Then, suddenly, a few large customers run into a crisis.

                    Orders slow down. The warehouses fill up with part X. Prices fall.

                    The company downsizes. Then it downsizes again. But nobody really notices, because stocks are still full. Customers are not yet affected. Purchasing departments can still get part X from inventory. Balance sheets still look fine. The problem has not yet reached the spreadsheet.

                    If this goes on for long enough, the company goes broke.

                    Again, nobody really notices. Stocks are still full. Some people may worry, but as long as no current production line is stopping and no quarterly number is visibly bleeding, nothing urgent is done.

                    The employees move on. They retire, change industries, start new careers. The old machine is sold for scrap. The building is repurposed. The knowledge evaporates.

                    Recovery

                    A few years later, demand picks up again.

                    The warehouses slowly empty. Stocks run low. People start ordering part X again, only to discover that nobody is offering it anymore.

                    Now someone decides to restart production.

                    The first thing they discover is that there is no machine. Building a new one would be prohibitively expensive, assuming anyone still knows how to build it properly. So they desperately search for an old one.

                    They get lucky. In a scrapyard, they find a machine that used to produce part X. It is rusted, incomplete, and dysfunctional. Naturally, they buy it.

                    Now they try to get it working again.

                    But there is another problem. There are no people left who know how to maintain it. So they hire someone who understands industrial maintenance in general, but has never worked on this specific machine. That person does their best. They improvise. They read old manuals. They reverse-engineer undocumented fixes. They keep the machine alive with skill, patience, and increasing amounts of despair.

                    But it breaks down every few hours. Output is abysmal.

                    Bottlenecks

                    And now that one poor maintenance person is overworked. They need help. But training help requires time, and the only person who can train others is the same person needed to keep the machine barely running. Every hour spent teaching is an hour not spent preventing the next failure.

                    Very few businesses survive this phase.

                    There is no institutional knowledge anymore. New people are hired, begin training, look at the state of the machine, the chaos of the process, and the constant emergency mode, and conclude that the business is doomed anyway. Then they quit.

                    Churn becomes terrible. Even if the company survives financially, it remains fragile. It is always just one or two people quitting away from disaster.

                    At the end the world decides it needs to get rid of part X as the supply is too fragile.

                    Summary

                    This is still very much simplified. The reality is more complex, more ugly.

                    And that is the part many people miss: a supply chain is not just warehouses, contracts, prices, and transport routes. It is also people, habits, obsolete machines, informal knowledge, and boring little skills that nobody values until they are gone.

                    jdlbt@techhub.socialJ This user is from outside of this forum
                    jdlbt@techhub.socialJ This user is from outside of this forum
                    jdlbt@techhub.social
                    wrote last edited by
                    #39

                    @masek And part X's specification was ill defined all along. The new supplier interprets it differently and the products don't work with the part X from the new supplier.

                    1 Reply Last reply
                    0
                    • masek@infosec.exchangeM masek@infosec.exchange

                      What a lot of people do not understand is the fragility of supply chains.

                      Setup

                      Let us assume there is a part X that is used by a large number of other companies. It is not glamorous, it is not expensive, and nobody outside a small circle of specialists ever thinks about it. But it is needed. Without it, other products cannot be finished.

                      Everything is fine

                      Part X is made by a small company with a few dozen employees and a machine that is several decades old.

                      Everything runs smoothly. The company knows how to maintain the machine. They know how to operate it. They know its strange noises, its moods, its undocumented rituals. They know which lever needs a bit of persuasion on cold mornings and which replacement part must be machined by hand because nobody has made the original since 1987. They also know how to train new employees, because the knowledge still exists inside the company.

                      Crisis

                      Then, suddenly, a few large customers run into a crisis.

                      Orders slow down. The warehouses fill up with part X. Prices fall.

                      The company downsizes. Then it downsizes again. But nobody really notices, because stocks are still full. Customers are not yet affected. Purchasing departments can still get part X from inventory. Balance sheets still look fine. The problem has not yet reached the spreadsheet.

                      If this goes on for long enough, the company goes broke.

                      Again, nobody really notices. Stocks are still full. Some people may worry, but as long as no current production line is stopping and no quarterly number is visibly bleeding, nothing urgent is done.

                      The employees move on. They retire, change industries, start new careers. The old machine is sold for scrap. The building is repurposed. The knowledge evaporates.

                      Recovery

                      A few years later, demand picks up again.

                      The warehouses slowly empty. Stocks run low. People start ordering part X again, only to discover that nobody is offering it anymore.

                      Now someone decides to restart production.

                      The first thing they discover is that there is no machine. Building a new one would be prohibitively expensive, assuming anyone still knows how to build it properly. So they desperately search for an old one.

                      They get lucky. In a scrapyard, they find a machine that used to produce part X. It is rusted, incomplete, and dysfunctional. Naturally, they buy it.

                      Now they try to get it working again.

                      But there is another problem. There are no people left who know how to maintain it. So they hire someone who understands industrial maintenance in general, but has never worked on this specific machine. That person does their best. They improvise. They read old manuals. They reverse-engineer undocumented fixes. They keep the machine alive with skill, patience, and increasing amounts of despair.

                      But it breaks down every few hours. Output is abysmal.

                      Bottlenecks

                      And now that one poor maintenance person is overworked. They need help. But training help requires time, and the only person who can train others is the same person needed to keep the machine barely running. Every hour spent teaching is an hour not spent preventing the next failure.

                      Very few businesses survive this phase.

                      There is no institutional knowledge anymore. New people are hired, begin training, look at the state of the machine, the chaos of the process, and the constant emergency mode, and conclude that the business is doomed anyway. Then they quit.

                      Churn becomes terrible. Even if the company survives financially, it remains fragile. It is always just one or two people quitting away from disaster.

                      At the end the world decides it needs to get rid of part X as the supply is too fragile.

                      Summary

                      This is still very much simplified. The reality is more complex, more ugly.

                      And that is the part many people miss: a supply chain is not just warehouses, contracts, prices, and transport routes. It is also people, habits, obsolete machines, informal knowledge, and boring little skills that nobody values until they are gone.

                      realgene@hachyderm.ioR This user is from outside of this forum
                      realgene@hachyderm.ioR This user is from outside of this forum
                      realgene@hachyderm.io
                      wrote last edited by
                      #40

                      @masek
                      In Silo / the Wool series, was the concept of "shadows", or more commonly, apprentices. You don't stop your work to train your successor, they work beside you, first carrying the tools, then holding the tools, then using the tools.

                      We used to call it "on the job training", because it was.

                      And suppliers need to learn an important concept: when demand *drops* your price must *rise*.

                      That signals your buyers to either hold more inventory, or find an alternative, by either designing your part out or trying to convince someone else to make it. Both of which are harder than paying the increased price.

                      1 Reply Last reply
                      0
                      • G gwentlarry@mastodon.social

                        @masek

                        Sounds a bit like the story of COBOL.

                        I wonder how many financial institutions still rely on COBOL somewhere in their systems and have nobody in-house who understands it?

                        Instead relying on outside contractors employing the few remaining and ageing COBOL specialists.

                        What happens when they finally retire and/or die?

                        artharg@mastodon.nlA This user is from outside of this forum
                        artharg@mastodon.nlA This user is from outside of this forum
                        artharg@mastodon.nl
                        wrote last edited by
                        #41

                        @gwentlarry @masek The Dutch government. In a frenzy of neoliberal market think they left many things to “the market”, getting rid of civil servants with domain knowledge. “Small government”, you know?

                        It got so bad that they couldn’t even put out a proper tender or manage an infrastructure project. And don’t get us started on government IT projects.

                        1 Reply Last reply
                        0
                        • masek@infosec.exchangeM masek@infosec.exchange

                          What a lot of people do not understand is the fragility of supply chains.

                          Setup

                          Let us assume there is a part X that is used by a large number of other companies. It is not glamorous, it is not expensive, and nobody outside a small circle of specialists ever thinks about it. But it is needed. Without it, other products cannot be finished.

                          Everything is fine

                          Part X is made by a small company with a few dozen employees and a machine that is several decades old.

                          Everything runs smoothly. The company knows how to maintain the machine. They know how to operate it. They know its strange noises, its moods, its undocumented rituals. They know which lever needs a bit of persuasion on cold mornings and which replacement part must be machined by hand because nobody has made the original since 1987. They also know how to train new employees, because the knowledge still exists inside the company.

                          Crisis

                          Then, suddenly, a few large customers run into a crisis.

                          Orders slow down. The warehouses fill up with part X. Prices fall.

                          The company downsizes. Then it downsizes again. But nobody really notices, because stocks are still full. Customers are not yet affected. Purchasing departments can still get part X from inventory. Balance sheets still look fine. The problem has not yet reached the spreadsheet.

                          If this goes on for long enough, the company goes broke.

                          Again, nobody really notices. Stocks are still full. Some people may worry, but as long as no current production line is stopping and no quarterly number is visibly bleeding, nothing urgent is done.

                          The employees move on. They retire, change industries, start new careers. The old machine is sold for scrap. The building is repurposed. The knowledge evaporates.

                          Recovery

                          A few years later, demand picks up again.

                          The warehouses slowly empty. Stocks run low. People start ordering part X again, only to discover that nobody is offering it anymore.

                          Now someone decides to restart production.

                          The first thing they discover is that there is no machine. Building a new one would be prohibitively expensive, assuming anyone still knows how to build it properly. So they desperately search for an old one.

                          They get lucky. In a scrapyard, they find a machine that used to produce part X. It is rusted, incomplete, and dysfunctional. Naturally, they buy it.

                          Now they try to get it working again.

                          But there is another problem. There are no people left who know how to maintain it. So they hire someone who understands industrial maintenance in general, but has never worked on this specific machine. That person does their best. They improvise. They read old manuals. They reverse-engineer undocumented fixes. They keep the machine alive with skill, patience, and increasing amounts of despair.

                          But it breaks down every few hours. Output is abysmal.

                          Bottlenecks

                          And now that one poor maintenance person is overworked. They need help. But training help requires time, and the only person who can train others is the same person needed to keep the machine barely running. Every hour spent teaching is an hour not spent preventing the next failure.

                          Very few businesses survive this phase.

                          There is no institutional knowledge anymore. New people are hired, begin training, look at the state of the machine, the chaos of the process, and the constant emergency mode, and conclude that the business is doomed anyway. Then they quit.

                          Churn becomes terrible. Even if the company survives financially, it remains fragile. It is always just one or two people quitting away from disaster.

                          At the end the world decides it needs to get rid of part X as the supply is too fragile.

                          Summary

                          This is still very much simplified. The reality is more complex, more ugly.

                          And that is the part many people miss: a supply chain is not just warehouses, contracts, prices, and transport routes. It is also people, habits, obsolete machines, informal knowledge, and boring little skills that nobody values until they are gone.

                          skeecr@mastodon.socialS This user is from outside of this forum
                          skeecr@mastodon.socialS This user is from outside of this forum
                          skeecr@mastodon.social
                          wrote last edited by
                          #42

                          @masek much of what you describe has parallels in the US academic scientific enterprise. Labs are specialized. They use unique, often home-grown, assays and equipment. Technicians keep them running and train replacements. When there’s a lapse in government funding (ie grants and contracts), staff/knowledge are lost, equipment fails, and it’s remarkably difficult and costly to return to normal if funding resumes. #science

                          browngreen57@mastodon.onlineB 1 Reply Last reply
                          0
                          • raymaccarthy@mastodon.ieR raymaccarthy@mastodon.ie

                            @masek
                            Also the machine or part may be a design never patented, so as to keep it a trade secret. Or the patent only covers an earlier uneconomic version.
                            Text books, patents, Wikipedia etc only have general theory or descriptions. None have the exact "recipe" of Part X or the machine to make it.

                            This makes Musk's claim to be setting up a semi-fab production for ICs (GPUs, RAM, Flash, CPUs etc) in space somewhat dubious. He'd have to buy in existing machines & experts. It's not public info.

                            artharg@mastodon.nlA This user is from outside of this forum
                            artharg@mastodon.nlA This user is from outside of this forum
                            artharg@mastodon.nl
                            wrote last edited by
                            #43

                            @raymaccarthy @masek He’s planning what now? Does he have any idea what kind of environment and support ASML’s EUV machines require? And he wants to load one on a rocket and launch it into space?

                            raymaccarthy@mastodon.ieR 1 Reply Last reply
                            0
                            • masek@infosec.exchangeM masek@infosec.exchange

                              What a lot of people do not understand is the fragility of supply chains.

                              Setup

                              Let us assume there is a part X that is used by a large number of other companies. It is not glamorous, it is not expensive, and nobody outside a small circle of specialists ever thinks about it. But it is needed. Without it, other products cannot be finished.

                              Everything is fine

                              Part X is made by a small company with a few dozen employees and a machine that is several decades old.

                              Everything runs smoothly. The company knows how to maintain the machine. They know how to operate it. They know its strange noises, its moods, its undocumented rituals. They know which lever needs a bit of persuasion on cold mornings and which replacement part must be machined by hand because nobody has made the original since 1987. They also know how to train new employees, because the knowledge still exists inside the company.

                              Crisis

                              Then, suddenly, a few large customers run into a crisis.

                              Orders slow down. The warehouses fill up with part X. Prices fall.

                              The company downsizes. Then it downsizes again. But nobody really notices, because stocks are still full. Customers are not yet affected. Purchasing departments can still get part X from inventory. Balance sheets still look fine. The problem has not yet reached the spreadsheet.

                              If this goes on for long enough, the company goes broke.

                              Again, nobody really notices. Stocks are still full. Some people may worry, but as long as no current production line is stopping and no quarterly number is visibly bleeding, nothing urgent is done.

                              The employees move on. They retire, change industries, start new careers. The old machine is sold for scrap. The building is repurposed. The knowledge evaporates.

                              Recovery

                              A few years later, demand picks up again.

                              The warehouses slowly empty. Stocks run low. People start ordering part X again, only to discover that nobody is offering it anymore.

                              Now someone decides to restart production.

                              The first thing they discover is that there is no machine. Building a new one would be prohibitively expensive, assuming anyone still knows how to build it properly. So they desperately search for an old one.

                              They get lucky. In a scrapyard, they find a machine that used to produce part X. It is rusted, incomplete, and dysfunctional. Naturally, they buy it.

                              Now they try to get it working again.

                              But there is another problem. There are no people left who know how to maintain it. So they hire someone who understands industrial maintenance in general, but has never worked on this specific machine. That person does their best. They improvise. They read old manuals. They reverse-engineer undocumented fixes. They keep the machine alive with skill, patience, and increasing amounts of despair.

                              But it breaks down every few hours. Output is abysmal.

                              Bottlenecks

                              And now that one poor maintenance person is overworked. They need help. But training help requires time, and the only person who can train others is the same person needed to keep the machine barely running. Every hour spent teaching is an hour not spent preventing the next failure.

                              Very few businesses survive this phase.

                              There is no institutional knowledge anymore. New people are hired, begin training, look at the state of the machine, the chaos of the process, and the constant emergency mode, and conclude that the business is doomed anyway. Then they quit.

                              Churn becomes terrible. Even if the company survives financially, it remains fragile. It is always just one or two people quitting away from disaster.

                              At the end the world decides it needs to get rid of part X as the supply is too fragile.

                              Summary

                              This is still very much simplified. The reality is more complex, more ugly.

                              And that is the part many people miss: a supply chain is not just warehouses, contracts, prices, and transport routes. It is also people, habits, obsolete machines, informal knowledge, and boring little skills that nobody values until they are gone.

                              joeinwynnewood@mstdn.socialJ This user is from outside of this forum
                              joeinwynnewood@mstdn.socialJ This user is from outside of this forum
                              joeinwynnewood@mstdn.social
                              wrote last edited by
                              #44

                              @masek

                              There's a good argument that how well any enterprise manages its bottlenecks determines its success.

                              The Theory of Constraints (TOC) is all about ways to identify and effectively manage bottlenecks of all kinds.

                              TOC may not be the be all and end all, but I think it has real value for almost any endeavor.
                              https://www.tocinstitute.org/theory-of-constraints.html
                              https://strategiccfo.com/theory-of-constraints/

                              1 Reply Last reply
                              0
                              • artharg@mastodon.nlA artharg@mastodon.nl

                                @raymaccarthy @masek He’s planning what now? Does he have any idea what kind of environment and support ASML’s EUV machines require? And he wants to load one on a rocket and launch it into space?

                                raymaccarthy@mastodon.ieR This user is from outside of this forum
                                raymaccarthy@mastodon.ieR This user is from outside of this forum
                                raymaccarthy@mastodon.ie
                                wrote last edited by
                                #45

                                @ArtHarg @masek
                                No, he's going to make the chips in Texas or somewhere in USA.
                                Only the finished parts in space. The totally insane fantasy "Million data centres in space" plan. Theory is cheaper electricity.
                                Issues:
                                1. Cooling is really real hard.
                                2. No maintenance possible, short life.
                                3. Solar Electricity in space does use less batteries, but cost of parts is much higher and PV panels wear out faster.
                                4. Cost of Radiation Hardening
                                5. Cost of launches + building higher.
                                6. Manoeuvre fuel

                                1 Reply Last reply
                                0
                                • masek@infosec.exchangeM masek@infosec.exchange

                                  What a lot of people do not understand is the fragility of supply chains.

                                  Setup

                                  Let us assume there is a part X that is used by a large number of other companies. It is not glamorous, it is not expensive, and nobody outside a small circle of specialists ever thinks about it. But it is needed. Without it, other products cannot be finished.

                                  Everything is fine

                                  Part X is made by a small company with a few dozen employees and a machine that is several decades old.

                                  Everything runs smoothly. The company knows how to maintain the machine. They know how to operate it. They know its strange noises, its moods, its undocumented rituals. They know which lever needs a bit of persuasion on cold mornings and which replacement part must be machined by hand because nobody has made the original since 1987. They also know how to train new employees, because the knowledge still exists inside the company.

                                  Crisis

                                  Then, suddenly, a few large customers run into a crisis.

                                  Orders slow down. The warehouses fill up with part X. Prices fall.

                                  The company downsizes. Then it downsizes again. But nobody really notices, because stocks are still full. Customers are not yet affected. Purchasing departments can still get part X from inventory. Balance sheets still look fine. The problem has not yet reached the spreadsheet.

                                  If this goes on for long enough, the company goes broke.

                                  Again, nobody really notices. Stocks are still full. Some people may worry, but as long as no current production line is stopping and no quarterly number is visibly bleeding, nothing urgent is done.

                                  The employees move on. They retire, change industries, start new careers. The old machine is sold for scrap. The building is repurposed. The knowledge evaporates.

                                  Recovery

                                  A few years later, demand picks up again.

                                  The warehouses slowly empty. Stocks run low. People start ordering part X again, only to discover that nobody is offering it anymore.

                                  Now someone decides to restart production.

                                  The first thing they discover is that there is no machine. Building a new one would be prohibitively expensive, assuming anyone still knows how to build it properly. So they desperately search for an old one.

                                  They get lucky. In a scrapyard, they find a machine that used to produce part X. It is rusted, incomplete, and dysfunctional. Naturally, they buy it.

                                  Now they try to get it working again.

                                  But there is another problem. There are no people left who know how to maintain it. So they hire someone who understands industrial maintenance in general, but has never worked on this specific machine. That person does their best. They improvise. They read old manuals. They reverse-engineer undocumented fixes. They keep the machine alive with skill, patience, and increasing amounts of despair.

                                  But it breaks down every few hours. Output is abysmal.

                                  Bottlenecks

                                  And now that one poor maintenance person is overworked. They need help. But training help requires time, and the only person who can train others is the same person needed to keep the machine barely running. Every hour spent teaching is an hour not spent preventing the next failure.

                                  Very few businesses survive this phase.

                                  There is no institutional knowledge anymore. New people are hired, begin training, look at the state of the machine, the chaos of the process, and the constant emergency mode, and conclude that the business is doomed anyway. Then they quit.

                                  Churn becomes terrible. Even if the company survives financially, it remains fragile. It is always just one or two people quitting away from disaster.

                                  At the end the world decides it needs to get rid of part X as the supply is too fragile.

                                  Summary

                                  This is still very much simplified. The reality is more complex, more ugly.

                                  And that is the part many people miss: a supply chain is not just warehouses, contracts, prices, and transport routes. It is also people, habits, obsolete machines, informal knowledge, and boring little skills that nobody values until they are gone.

                                  maya_b@hachyderm.ioM This user is from outside of this forum
                                  maya_b@hachyderm.ioM This user is from outside of this forum
                                  maya_b@hachyderm.io
                                  wrote last edited by
                                  #46

                                  @masek

                                  2021 demonstrated it's not even obscure parts - and that the entire supply chain can collapse for whole industries eg electronics.

                                  and it's not even exotic parts - the mid 2010s capacitor shortage, blamed on a factory fire, was for everyday forgettable parts that cost fractions of a cent, suddenly became. Rumor has it that the fire had nothing to do with it, but the factories just wanted to up their prices from $0.003/unit.

                                  1 Reply Last reply
                                  0
                                  • jt_rebelo@ciberlandia.ptJ jt_rebelo@ciberlandia.pt

                                    @masek and the consequences of AI. Once the knowledge is gone, it's probably gone for good or, at least, for a long time.

                                    gustodon@mas.toG This user is from outside of this forum
                                    gustodon@mas.toG This user is from outside of this forum
                                    gustodon@mas.to
                                    wrote last edited by
                                    #47

                                    @jt_rebelo This is why we had to learn how to build rockets again.

                                    jt_rebelo@ciberlandia.ptJ 1 Reply Last reply
                                    0
                                    • gustodon@mas.toG gustodon@mas.to

                                      @jt_rebelo This is why we had to learn how to build rockets again.

                                      jt_rebelo@ciberlandia.ptJ This user is from outside of this forum
                                      jt_rebelo@ciberlandia.ptJ This user is from outside of this forum
                                      jt_rebelo@ciberlandia.pt
                                      wrote last edited by
                                      #48

                                      @Gustodon don't remind me I should buy even more physical books...

                                      1 Reply Last reply
                                      0
                                      • S stinson_108@mastodon.social

                                        @masek

                                        As long as sea lanes remain open, #tariffs stable, and no currency restrictions, the market will figure out the proper complexity of supply chains. Pandemics and ships sideways in the #Suez can be overcome. Like everything else, it's the idiocy of our leaders we should fear.

                                        menos@todon.euM This user is from outside of this forum
                                        menos@todon.euM This user is from outside of this forum
                                        menos@todon.eu
                                        wrote last edited by
                                        #49

                                        @Stinson_108 Iow markets are fantastic at finding an optimal (i.e. most profitable) solution unless you expose them to the real world.
                                        @masek

                                        1 Reply Last reply
                                        0
                                        • raymaccarthy@mastodon.ieR raymaccarthy@mastodon.ie

                                          @rcosta @eckes @jt_rebelo @masek
                                          That's a rare example of 3D printing to the rescue. Helped due to low volume.

                                          No, it's not primarily environmental. It's lack of investment in training, lack of open source documentation (or even any under NDA) and lack of second sources.

                                          Yes, building to last, repair and reuse are important. But only tangential to supply chain risks.

                                          rcosta@archaeo.socialR This user is from outside of this forum
                                          rcosta@archaeo.socialR This user is from outside of this forum
                                          rcosta@archaeo.social
                                          wrote last edited by
                                          #50

                                          @raymaccarthy @eckes @jt_rebelo @masek "lack of open source documentation", I agree and that can be fixed without a big investment is more a matter of political will. But I maintain my views to systemic causes, specially the ones related with predatory economics. Greedy CEOs scrapping machines, ending internships and factory repair workshops, etc. Lack of parts is old as industrialization itself, is inevitable. We only can delay it and choose how to deal with it when finally happens.

                                          1 Reply Last reply
                                          0
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Login or register to search.
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups