Accendo Reliability

Your Reliability Engineering Professional Development Site

  • Home
  • About
    • Contributors
  • Reliability.fm
    • Speaking Of Reliability
    • Rooted in Reliability: The Plant Performance Podcast
    • Quality during Design
    • Critical Talks
    • Dare to Know
    • Maintenance Disrupted
    • Metal Conversations
    • The Leadership Connection
    • Practical Reliability Podcast
    • Reliability Matters
    • Reliability it Matters
    • Maintenance Mavericks Podcast
    • Women in Maintenance
    • Accendo Reliability Webinar Series
    • Asset Reliability @ Work
  • Articles
    • CRE Preparation Notes
    • on Leadership & Career
      • Advanced Engineering Culture
      • Engineering Leadership
      • Managing in the 2000s
      • Product Development and Process Improvement
    • on Maintenance Reliability
      • Aasan Asset Management
      • CMMS and Reliability
      • Conscious Asset
      • EAM & CMMS
      • Everyday RCM
      • History of Maintenance Management
      • Life Cycle Asset Management
      • Maintenance and Reliability
      • Maintenance Management
      • Plant Maintenance
      • Process Plant Reliability Engineering
      • ReliabilityXperience
      • RCM Blitz®
      • Rob’s Reliability Project
      • The Intelligent Transformer Blog
    • on Product Reliability
      • Accelerated Reliability
      • Achieving the Benefits of Reliability
      • Apex Ridge
      • Metals Engineering and Product Reliability
      • Musings on Reliability and Maintenance Topics
      • Product Validation
      • Reliability Engineering Insights
      • Reliability in Emerging Technology
    • on Risk & Safety
      • CERM® Risk Insights
      • Equipment Risk and Reliability in Downhole Applications
      • Operational Risk Process Safety
    • on Systems Thinking
      • Communicating with FINESSE
      • The RCA
    • on Tools & Techniques
      • Big Data & Analytics
      • Experimental Design for NPD
      • Innovative Thinking in Reliability and Durability
      • Inside and Beyond HALT
      • Inside FMEA
      • Integral Concepts
      • Learning from Failures
      • Progress in Field Reliability?
      • Reliability Engineering Using Python
      • Reliability Reflections
      • Testing 1 2 3
      • The Manufacturing Academy
  • eBooks
    • Reliability Engineering Management DRAFT
  • Resources
    • Accendo Authors
    • FMEA Resources
    • Feed Forward Publications
    • Openings
    • Books
    • Webinars
    • Journals
    • Higher Education
    • Podcasts
  • Courses
    • 14 Ways to Acquire Reliability Engineering Knowledge
    • Reliability Analysis Methods online course
    • Measurement System Assessment
    • SPC-Process Capability Course
    • Design of Experiments
    • Foundations of RCM online course
    • Quality during Design Journey
    • Reliability Engineering Statistics
    • An Introduction to Reliability Engineering
    • An Introduction to Quality Engineering
    • Process Capability Analysis course
    • Root Cause Analysis and the 8D Corrective Action Process course
    • Return on Investment online course
    • CRE Preparation Online Course
    • Quondam Courses
  • Webinars
    • Upcoming Live Events
  • Calendar
    • Call for Papers Listing
    • Upcoming Webinars
    • Webinar Calendar
  • Login
    • Member Home

by Larry George 1 Comment

How Can You Estimate Reliability Without Life Data?

How Can You Estimate Reliability Without Life Data?

Myron Tribus’ UCLA Statistical Thermodynamics class introduced me to entropy, -Sp(t)ln(p(t)). (p(t) is the probability of state t of a system.) Professor Tribus later advocated maximum-entropy reliability estimation, because that “…best represents the current state of knowledge about a system…” [Principle of maximum entropy – Wikipedia] Caution! This article contain statistical neurohazards.

Claude Shannon wrote that entropy (log base 2) represents information bits, “…an absolute mathematical limit on how well data from the source can be losslessly compressed onto a perfectly noiseless channel.”  [Beirlant et al.]

Maximum likelihood estimation is one way to estimate reliability from data. It maximizes the probability density function of observed data, Pp(t), e.g., for observed failures at ages t. It is equivalent to maximize -Sln(p(t). Maximum entropy reliability estimation maximizes entropy -Sp(t)ln(p(t). That’s same as maximizing the expected value, -Sp(t)ln(p(t), of the log likelihood -ln(p(t). Fine, if you have life data, ages at failures t censored or not.

What if You Don’t Have Life Data?

There’s reliability information in ships and returns counts [Want Field Reliability, Without Life Data? (accendoreliability.com)]. How much information? Compare the information (entropy) in reliability estimates from life data vs. estimates without life data (period ships and return counts); i.e., -S[p(t)ln(p(t)) conditional on life data vs. -S[q(t)ln(q(t))] conditional on ships at rate l(t) and returns R(t). The relative entropy or information loss, -S[p(t)ln(p(t)/q(t)), is the Kullback-Leibler divergence (between estimates with vs. without life data).

If you want more about the equivalence among maximum likelihood estimation, information, entropy, and Kullback-Leibler divergence, see the following references. [David Darmon, ThirdOrderScientist, https://thirdorderscientist.org/homoclinic-orbit/2013/4/1/maximum-likelihood-and-entropy/ and Korbinian Strimmer, http://www.strimmerlab.org/publications/lecture-notes/MATH20802/02-likelihood2.html]. For comparisons with vs. without life data, see https://sites.google.com/site/fieldreliability/random-tandem-queues-and-reliability-estimation-without-life-data/.

How to get Field Reliability Information from Ships and Returns?

Imagine that a product’s or part’s lifetime is the service time in a self-service system. Observe an M/G/infinity (queue) without identifying individual products or parts. (“M” denotes Poisson inputs at rate l (“ships”), “G” denotes the service time cumulative distribution function G(t), and “infinity” means self-service.) M/G/infinity inputs and outputs correspond to ships and returns. Cumulative outputs (“returns”) have Poisson distribution with mean lG(t), where t is the time from start of the system’s inputs [Mirasol]. If you knew or estimate input rate l, you could estimate G(t) from output counts R(t1), R(t2),… in periods t1, t2,… The estimates could be G(t1) = R(t1)/l, G(t2) = (R(t1)+R(t2))/2l,… BUT, because a cumulative distribution function G(t) is not supposed to decrease with age t, estimation requires “majorization,” i.e., a way to make the estimates of G(t) non-decreasing.

How to Maximize the Likelihood Function of Ships and Returns Counts?

Cory Atwood, Editor of the ASA SPES Newsletter that published my 1999 article, asked me for the likelihood function for M/G/infinity inputs and outputs. The likelihood function is the product, PPoisson[R(t), lg(t)], where Poisson[count, mean] is the Poisson probability of R(t) outputs (returns) in period t from prior ships cohorts S(s) s£t. The likelihood function is a product, because Poisson processes have independent increments (periods). The system output rate lg(t) in period t is the input rate times the probability density function g(t) of the lifetime distribution G(t).

Albert Marshall and Frank Proschan proved that majorization gave the maximum likelihood estimator of a increasing failure rate function from periodic failure rate estimates. That is equivalent to maximizing the likelihood of the outputs of an M/G/infinity system. I borrowed a majorization method called “Pool Adjacent Violators Algorithm” (PAVA) [Barlow et al.]. The PAVA majorization formula for Poisson output at cumulative rate lG(t) is

$$ \displaystyle \lambda G\left(t_{k}\right)=max_{1\leq\alpha\leq k}min_{k\leq\beta\leq n}\left\{ \frac{R\left(\alpha\right)+R\left(\alpha+1\right)+\ldots+R\left(\beta\right)}{S\left(\alpha\right)+S\left(\alpha+1\right)+\ldots+S\left(\beta\right)}\right\} $$

for k = 1,2,…,n, where n is the total number of ships cohorts, S(t) are ships and R(t) are returns in period t.

Basically, PAVA means, if estimates “violate”, i.e., G(t1)>G(t2) for some t1<t2, “pool” the adjacent estimates of G(t1) and G(t2). So the maximum likelihood estimate of G(t) is the “majorized” λG(t)/λ.

How to Compute a Reliability Estimate from Ships and Returns?

Spreadsheet “npmle.xlsx” tables 3 and 4 in https://sites.google.com/site/fieldreliability/home/files-workbooks-etc  implements PAVA. Mark Felthauser converted my PAVA spreadsheet and VBA software into R script that implements PAVA. I converted Mark’s R script into an R script that directly maximizes the Poisson likelihood function and deals with inadmissible or missing data. If you prefer R scripts, let me know, or else use npmle.xlsx or send your ships and returns data to pstlarry@yahoo.com to make nonparametric population estimates of your products’ or parts’ field reliability functions without life data.

References

  1. E. Barlow, D. J. Bartholomew, J. M. Bremner, and H. D. Brunk, “Statistical Inference Under Order Restrictions,” John Wiley & Sons, Dec. 1973, https://doi.org/10.1111/j.1467-9574.1973.tb00228.x
  2. Beirlant, E. J. Dudewicz, L. Györgi, E. C. van der Meulen, “Nonparametric Entropy Estimation: an Overview,” July 2001
  3. L. George, “Field Reliability Estimation Without Life Data,” ASA SPES Newsletter, Dec. 1999
  4. L. George, “Random-Tandem Queues and Reliability Estimation Without Life Data,” 2019, Random-Tandem Queues and Reliability Estimation, WIthout Life Data – Field Reliability (google.com), RANDTAND.DOCX or RANDTAND.PDF
  5. W. Marshall and F. Proschan, “Maximum Likelihood Estimation for Distributions with Monotone Failure Rate,” The Annals of Mathematical Statistics, 36, 69-77 (1965)
  6. M. Mirasol, The Output of an M/G/infinity Queuing System is Poisson,” Operations Research, 11, 282-284, (1963)

Claude Shannon, “Mathematical Theory of Communication,” Bell System Technical Journal, Vol. 27 (4): 623–656, (1948). doi:10.1002/j.1538-7305.1948.tb00917.x.

Filed Under: Articles, on Tools & Techniques, Progress in Field Reliability?

« The ‘Soft Side’ of RCA: Management’s Role in ‘Effective’ Training
Creating a Histogram »

Comments

  1. Larry George says

    May 17, 2021 at 10:49 AM

    Thank Fred for getting the formula translated nicely.
    Sorry about that: some Greek letters or symbols didn’t translate:
    S =SUM as in entropy = SUM[p(t)log((t))]
    P = Product as in likelihood = PRODUCT[Poisson(.,.)]
    l = lambda as in lambda*G(t)
    scrambled egg symbol should have been s <= t.
    I will spell out symbols in future articles.
    If you ask, pstlarry@yahoo.com, I will send *.docx or *.pdf version of article with original symbols.

    Reply

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Articles by Larry George
in the Progress in Field Reliability? article series

Join Accendo

Receive information and updates about articles and many other resources offered by Accendo Reliability by becoming a member.

It’s free and only takes a minute.

Join Today

Recent Articles

  • Terrorism Risk Insurance Act Exclusions: Gray Coverage Areas
  • Why Total Productive Maintenance Is The Answer To Reliability-Centered Culture
  • 17 Powerful Insights on Effective Communication Using FINESSE
  • Surprising Insights from Simple Run Charts
  • Risk is Round

© 2023 FMS Reliability · Privacy Policy · Terms of Service · Cookies Policy

This site uses cookies to give you a better experience, analyze site traffic, and gain insight to products or offers that may interest you. By continuing, you consent to the use of cookies. Learn how we use cookies, how they work, and how to set your browser preferences by reading our Cookies Policy.