Development and evaluation of a urine protein expert system
Transcription
Development and evaluation of a urine protein expert system
Clinical Chemistry 42:8 1214-1222 (1996) Development and evaluation of a urine protein expert system MIRosiv IVANDIC,* WALTER HOFMANN, Based on the quantitative determination of creatmine, total albumin, a1-microglobulin, IgG, a2-macroglobuliii, and N-acetyl-I3,n-glucosaininidase in urine in combination with a test strip screening, the findings of hematuria, leukocyturia, and proteinuria can be assigned to prerenal, renal, or postrenal causes. Using this graded diagnostic strategy as a knowledge base, we developed a computerbased expert system for urine protein differentiation (“UPES”) as a decision-supporting tool. The knowledge base was implemented as a combination of “Wthen” rules and two-step bivariate distance classffication of marker proteins. The knowledge for this form of pattern recognition was derived from the results for a set of 267 patients with clinically and histologically documented nephropathies. To determine the diagnostic value of UPES, we tested another set of data: results for 129 urine analyses from 94 patients. Using these data, the system reached 98% concordance with the clinical diagnoses for the patients and was superior to the diagnostic interpretations of four human experts. UPES has been successfully integrated into the laboratory routine process, including automated data import. ing system proteinuria nephropathy WALTER G. GUDER or, better, knowledge-based systems have been developed and are being used with increasing frequency. Laboratory medicine, given its high degree of specialization and its use of objective protein, INDEXING and quantitative findings, seems especially suited to benefit from these computer programs [1, 2]. Here we describe such a decision-supporting system, the Urine Protein Expert System (UPES), developed for the interpretation of urine protein differentiation.’ As with electrophoretic techniques [3-5], quantitative analysis of urine marker proteins has been successfully applied to detect and differentiate nephropathies [5-7]. The multivariate evaluation of the excretion pattern allows differentiation of prerenal from glomerular, tubular, and postrenal causes of proteinuria and hematuria [8-11]. Knowledge for describing and interpreting complex urine protein patterns has accumulated in recent years, a result of collaboration between nephrologists and clinical chemists. We have tried to implement this knowledge in the form of “if/then” rules in the knowledge base of UPES, a knowledge base that contains facts and strategies drawn from literature as well as from heuristics and empirical guidelines. The rules have been worked out in close collaboration with specialists in the field of urine protein differentiation. Because various nephropathies could not be sufficiently identified by interpretation of excretion patterns when based on rules alone, we have used another method of knowledge representation, geometric distance classification, to extract and apply the knowledge of this multivariate pattern recognition. Using this hybrid model of a knowledge base, UPES is able to process the laboratory results provided and to propose a medical report generated from 36 text elements. Twenty-four of those elements (all the ones used in this paper) are listed in the Appendix. knowledge-based system . decision-supportalbumin . a,-microglobulin #{149} a2-macroglobulin #{149} kidney diseases #{149} hematuria #{149} leukocyturia TERMS: #{149} Continuously changing medical knowledge has resulted in increasing specialization in medicine. Providing optimal medical care requires experts who can keep up with the enormous information flow; however, such experts are not always available. To conserve the knowledge of a specialist and to widely distribute this knowledge, software tools called expert systems Matenais and Methods Analytical procedures. Test strip screening was performed with test strips from Behring (Marburg, Germany). Quantitative determinations of total protein, albumin, ce,-microglobulmn, IgG, a2-macroglobulmn (turbidimetrically), N-acetyi-/3,n-glu- Institut f#{252}r Klinische Chemie, St#{228}dt. Krankenhaus Munchen-Bogenhausen, Englschalkinger Str. 77, D-81925 Munchen, Germany. Author for correspondence. Fax +49 89 9270 2113; e-mail wguho@pclabor.uni-bremen.de. Dedicated to H. Keller of ZUrich (Switzerland), on the occasion of his 70th birthday. This paper contains part of the results of the doctoral thesis of MI. Received November 7, 1995; accepted April I, 1996. Nonstandard abbreviations: UPES, Urine Protein Expert System; /3-NAG, N-acervl-(3,o-glucosaminidase; and GFR, glomerular filtration rate. 1214 1215 Clinical Chemisliy 42, No. 8, 1996 cosaminidase (p-NAG) (kinetically and photometrically), and creatinine in urine as well as serum concentrations of creatinine and a1 -microglobulin were performed as described elsewhere [12]. The reference values used are from previous publications [7, 9]. Hardware and software. The knowledge-based system for urine protein analysis was developed by using an IBM-compatible PC (80386 CPU) with 1 MB RAM and DOS. A Turbo C Compiler (V. 2.0; Borland, Munich, Germany) and a BGI Printer Toolkit (Ryle Design, Mt. Pleasant, MI) served as programing tools. The statistical software package SAS (V. 6.10; SAS Institute, Cary, NC) was used to perform discriminant analysis. Geometric distance classification. Geometric distance classification is a method for describing and separating multidimensional pattern classes. Patterns are defined by complete quantitative or qualitative data. Patterns of distinguishable classes form distinct clusters in multidimensional spaces. In geometric distance classification, groups of geometric figures such as spheroids and ellipsoids are used to represent these clusters (Fig. 1). The distance classifier GEODICLA [13] was developed separately to determine the position and size of such spheroids and ellipsoids automatically. The program selects random members from each class from a training set of typical examples and defines their geometric “region of influence” [14]. This is done by taking their coordinates as the centers of the figures and extending a user-defined minimal radius until reaching either a maximum radius or the “nearest” example of a different class. If an example is picked that is already covered by a figure belonging to the same class, then this example can be classified already and does not need its own region of interest. When every training example is covered, the training is stopped. Reclassifying the training set now always results in a 100% classification rate. The resulting geometric shapes can be adapted manually after this automatic “learning process.” Using the software tool GEODICLA, we have generalized the information contained in the urine protein patterns of two training sets and condensed them into two sets of figures: circles and ellipses. To classify an unknown urine pattern, we compare it with these representatives sets in UPES: The geometric distance from this pattern to the centers of each of the circles! ellipses is calculated and compared with the radius of each circle/ellipse. If the pattern lies within a circle/ellipse, the associated class is stored. Comparison of the stored classes leads UPES to its diagnostic conclusion. Training sets. Protein patterns of 503 second morning urines from 267 patients with clinically or histologically diagnosed nephropathies were used to train the distance classifier GEODICLA. Medical The urines were collected Department of the Hospital from patients of the II. Munchen-Harlaching and of the III. Medical Department and the Department of Neurosurgery of the Hospital Munchen-Bogenhausen. Depending on their clinical diagnoses, patients were assigned to the following diagnostic groups: primary glomerulopathy-different forms of glomerulonephritis, histologically secondary diagnoses interstitial thy, chronic umented documented glomerulopathy- diabetic nephropathies, clinical nephropathy-e.g., acute tubulo-toxic nephropainterstitial nephropathy, partly histologically doc- diagnoses renal dysfunction-protein excretion patterns ranging from normal values to as much as twice the upper reference limit from patients from any of these three diagnostic groups that were not histologically documented were based on clinical criteria (e.g., anamnesis, clinical examination, laboratory results,medical imaging, clinicalcourse) and made by Diagnoses the physician treating the patient. composition of the training set. Table 1 summarizes the Validation set.To evaluate the diagnostic interpretation of urine protein patterns, we used data from 129 urine analyses. These test data were collected from 94 patients of the II. Medical Department of the Hospital Munchen-Harlaching and the III. Medical Department of the Hospital Munchen-Bogenhausen. As in the training set, the urines were assigned to the diagnostic groups primary glomerulopathy, secondary glomerulopathy, and interstitial nephropathy, according to their diagnoses (Table 1). Discriminant analysis. To compare the diagnostic performance of the distance classifier with the performance of a statistical method, we performed classificatory linear and quadratic discriminant analysis. We used the training set to compute the parameters (coefficients and constants) of the linear and quadratic functions. Equal prior probabilities were assumed for all four diagnostic groups. The same validation data were used to evaluate the results of discriminant analysis as were used with geometric distance classification (Table 1). #{149} #{149}#{149}S #{149} a. #{149} #{149} #{149}#{149}.#{149} a #{149}% #{149}#{149}. #{149} a. #{149}S . #{149}SS U at #{149} #{149} U #{149}I. .R #{149} Fig. 1. Use of circles to describe clusters of two different classes: (A) individual examples of two different classes forming two distinct clusters; (B) an #{149} #{149}1 U... #{149}a U #{149}#{149}#{149} #{149} optimal characterization of the clusters by using six circles B. C. (GEODICLA; see text); (C) the representatives of the two classes. resulting six Ivandi#{233} et al.: Urine 1216 protein expert system (UPES) Table 1. Compos ition of the train ing and the valid ation collective. Training collective Urine Diagnostic samples Patients groups n Primary glomerulopathy 285 57 Secondary glomerulopathy 123 Interstitial nephropathy 66 Renal dysfunction Total 29 503 % n % n % 44 46 36 27 29 24 97 36 76 59 62 66 13 33 12 7 5 6 20 267 and glucose. As an option, the by providing glomerular filtrationrate (GFR) can be considered the data for serum Apart from creatinine and serum the results of the serum a,-microglobulin. and urine analysis, additional data concerning the patient and the request of the urine protein differentiation data can be entered into UPES by using an input screen or can be imported automatically by retrieving a file. KNOWLEDGE 7 - 5 - EASE The knowledge base of UPES is divided into five modulesPlausibility and consistency check, Hematuria, Leukocyturia, Proteinuria, and GFR-which are considered if necessary. The implemented strategy is represented as if/then rules. The geometric distance classification is used only in the Proteinuria module to interpret the marker protein patterns. 129 - 94 (see next section), Medicalassessment ofGFR. The GFR module is considered only if the concentrations of the optional serum analytes creatinine and a,-microglobulin are provided. a,-Microglobulin partially fills the diagnostic gap associated with creatinine, by sometimes detecting a decrease of GFR earlier than creatinine does [15- 17]. A major serum I; see Appendix).The GFR is assumed to be decreased if concentrations of both analytes are increased (text element 2). In combination with a normal urine excretion pattern, this is interpreted analytes restriction are within of the GFR their reference as a lossof functioning nephrons is unlikely ranges (text if both element that iscompletely compensated by the remaining nephrons (text element 3). An increase of only a,-microglobulin in serum indicates a possible restriction in glomerular clearance (diagnostic gap of creatinine). In this case, determination of creatinine clearance is recommended to confirm or to exclude this suspicion (text element 4). If only creatinine is increased, this more likely indicates the presence of pseudocreatinines or increased muscle mass (text element 5), given the greater diagnostic sensitivity of a, -microglobulin. Medical assessment of hematuria. Whenever the test strip result for blood is positive, the Hematuria module is considered, to distinguish Plausibility and consistemy check. All data are checked for plausibility during the input or import process; formats and thresholds are used to exclude values that exceed medical and analytical ranges. For analytical validation, this module considers the values for total protein, albumin, test strip protein, and the two serum measurements (creatinine and a,-microglobulin). A warning appears on the screen (“Discrepancy between test strip, albumin, and total protein!”) if the comparison of the test strip result and the quantitative measurements fulfills one of the following conditions: protein test strip positive and total protein 200 mg/L protein test strip negative and albumin >300 mg/L albumin > total protein and albumin >50 mg/L These rules take into account that the detection limit of the test strip is -300 mg/L albumin and thus detect false-positive and false-negative test strip results. If the value for urine protein excretion is normal and one of 5 - the serum values indicates a decreased GFR the user is asked to check the input data. For interpretation of a urine protein pattern, UPES requires at least the data for urine creatinine, total protein, albumin, and a,-microglobulin. For differential diagnosis during the decision process, the system asks for data on IgG, a2-macroglobulin, and p-NAG if necessary. The program refers all quantitative measurements to the urine creatinine content to take into account the concentration of the urine sample [7]. These quantitative data are processed together with the results of the urine test strips for assessing leukocytes (granulocyte esterase), hemogloprotein, Patients n DATA bin (pseudoperoxidase), Urine sampies 117 Results INPUT Validation collective prerenal from glomerular, tubular, and postrenal causes. Prerenal causes of the test strip result are assumed if the criteria for prerenal proteinuria are met (i.e., a “protein gap”; see text element 6) [18]. If albumin excretion is <100 mg/L, differentiationof renal and postrenal hematuria by urine protein analysis is not possible [9]. In such cases, UPES suggests using phase-contrast microscopy to look for dysmorphic ervthrocytes [19, 20] (text element 7). At higher albumin concentrations,the system considersthe ratios of albumin with a2-macroglobulin, IgG, and a,-microglobulin to assign the hematuria to a renal (glomerular or tubulo-interstitial)or postrenal bleeding [9, 10]. If a2-macroglobulin and lgG results have not yet been provided, UPES asks for theirmanual input. Because of their molecular size, only small amounts of a,-macroglobulin (250 kDa) and IgG (125 kDa) usually pass the glomerular filter,and those are reabsorbed in the tubule. When Clinical Cbemisy albumin ratios with these proteins in urine are similar to those in plasma, therefore, a postrenal lesion is indicated (a2-macroglobulinlalbumin >0.02 and IgG/albumin >0.2). In this case, the system proposes that the clinician repeat the urine protein differentiation to exclude additional renal hematuria Medical assessment of leukoyturia. The Leukocyturia module is considered whenever the leukocyte esteraseteststripshows a positive result. An isolated leukocyturia in combination with a normal urineproteinpatternindicateseithera contamination of the urine sample or an inflammation of the lower urinarytract (textelement 10).Leukocyturia with a slightglomerular proteinuria(totalprotein <150 mg/g creatinine,albumin <100 creatinine, a,-microglobulin <14 mg/g creatinine) can have both renaland postrenalcauses(textelement 11),whereas substantial glomerular involvement or tubular proteinuria indicates renal in an inflammatory process (text element 12). Medical assessment of proteinuria. In contrastto the previoustwo modules, the Proteinuria module is used in all cases to interpret the various urine protein ratios.Active renal diseasecan be excluded ifteststrip results are negative and the concentrations of urine totalprotein,albumin, and a,-microgbobulinarewithin their reference ranges (text element 13). Normal excretion of both marker proteinsbut increasedIgG in urine may indicate (e.g.)monoclonal gammopathies (textelement 14). If totalprotein excretion is >300 mg/L and the sum of albumin, protein a1-microglobulin, excretion, prerenal and IgG is <30% causes such as Bence of the total Jones protein- uria might account for this disproportion [18]. ImmunofIxation is suggested for further confirmation. This finding initiates temporary report (text element 15), and the decision process stopped. Renal described proteinuria and assigned can be quantitatively to different kinds and a is qualitatively of nephropathies 1217 Table 2. DescrIption of tubular and glomerular proteinurla according to the excretion of the marker proteins albumin and a1-microglobulin. a1.Microglobuiin Albumin after postrenal hematuria has ceased (text element 8). In renalhematuria (a2-macroglobulinlalbumin<0.02), gbmerular and tubulo-interstitial causes can be distinguished by the concentrations of IgG: In tubular hematuria, even small amounts of filtered IgG cannot be reabsorbed (IgG/albumin >0.2). Increased excretion of the tubular marker a,-microglobulin is taken as additional confirmation of the tubulointerstitial lesion (text element 9). mg/g 42, No. 8, 1996 by analysis of the excretion pattern of albumin, a,-microglobulin, and IgG. Using albumin as a glomerular marker and a1microglobulin as a tubular marker, UPES describes the extent of glomerular and tubularproteinuriaas borderline,slight, significant, distinct, and nephrotic, according to the thresholds given in Table 2. The IgG/albumin ratio helps to distinguish “selective” (<0.03) from “nonselective” (>0.03) proteinuria in gbmerulopathies with albuminuria >500 mg/g creatinine. An example of a description of a renal proteinuria is text element 16 (albumin 1100 mg/g creatinine, a,-microgbobulin 25 mg/g creatinine, IgG 15 mg/g creatinine). Apart from thisquantitativeand qualitativedescription,a renal proteinuria can also be assigned to different diagnostic classes of renal diseases. mg/g 14-20 20-50 50-100 >100 Description creatinine 20-30 Borderline 30-100 Slight 100-1000 1000-3000 >3000 Significant Distinct Njephrotic The training sets of patients with clinically or histologically documented diagnoses show that tububo-interstitial nephropathies and primary and secondary glomerubopathies are each characterized by a specific urine protein pattern. The clusters of these disease groups can be defined and separated in logarithmic coordinates, with the marker proteins albumin and a,-microglobulin making up the x- and y-axes, respectively (Fig. 2, top). A renalproteinuriawith albumin <40 mg/g creatinineand a,-microgbobulin <28 mg/g creatinine cannot be clearly assigned to only one of the three disease classes because of the overlapping zones of the clusters. Such a slight proteinuria can be interpretedas “renaldysfunction,”which can have renaland extrarenal causes: e.g., metabolic disorder, fever, intense physical exercise (see text element 17). In the overlapping zone between primary and secondary glomerubopathies as well as interstitial nephropathies, further diagnostic information might be achieved by takingIgG intoconsideration(Fig.2, bottom). An excretion pattern from an unknown patient can be assigned to any of the diagnostic groups by comparing it with the position of the different clusters in both coordinates. To implement thisvisualclassification in the knowledgebased system UPES, we used the geometric distance classifier GEODICLA [13]. After five fictitious patterns had been added to the training samples to detect implausible marker constellations (Fig. 2, top), and the learning and abstracting process of GEODICLA had been performed, the information contained in these 508 single urine protein patterns of the training sets was specifically condensed into some representative examples: The clusters of the different classes were now described with 60 circles (albumin-a,-microglobulin patterns) and 15 ellipses (albumin-IgG patterns). For diagnostic interpretation of urine findings of an unknown patient, UPES calculates the logarithm of the patient’s concentrations of albumin and a1-microglobulin. The geometric distance of this pattern to the centers of each of the 60 circles is calculated and compared with their radii. If the pattern lies within a circle, the corresponding class is stored. According to the classes stored after this first classification, the system identifies the excretionpatternas belonging with one of the following diagnostic groups: renal dysfunction (text element 17),primary glomerubopathy (textelement 18),secondary glomerubopathy (element 18), primary or secondary gbmerulopathy (text element 19),tubulo-interstitial nephropathy 1218 Ivandi#{233} et al.: Urine protein expert system (UPES) A 4 #{163} A 5o A aALA A A .#{149} Si AL LLj 0 A #{149} a, 0 jA #{149} Is #{149}. A x 10 S DOD S #{149} . . 0 iwo 10 ic Albumin (mglg creatinine) iww- a C iwo #{149} C #{163} a a a a SAL U E 0 10 Fig. 2. Albumin-a1-microglobulin patterns (top) and albumin-lgG patterns (bottom) of the diagnostic classesof the training a A a #{163} collective: S thies 10 ito Albumin iwo a,-microglobulin - primary nephropa- () and secondary(#{149}) glomerulopathies, the dysfunctional collective (*) and the plausibility collective (#{149}). (mglg creatinine) (element 18), glomerulopathy with interstitial involvement or interstitial nephropathy with secondary glomerulopathy (text element 20),or implausiblemarker proteinpattern. Only ifthisfirst classification based on the a,-microgbobulinl albumin ratiorevealsan ambiguous diagnosis(elements 19 and 20) does UPES consider IgG in a second step: One of a pair of diagnoses in an ambiguous diagnosis is more probable if the albumin/IgG pattern of the patient is covered by ellipses of only one class(unambiguous classification; text element 21). This two-step pattern identification in UPES reflects that the diagnostic discrimatory power of IgG is less than that of a1microgbobulin. Depending on the result of the two-step classification, additional rules are considered. If the diagnostic pattern classification reveals a glomerulopathy, the system takes into account the possibility that the tubular component of a proteinuriamight resultfrom tubularoverload caused by an excessiveglomerular proteinuria. In nephrotic proteinuria (albumin >3 g/g creatinine),therefore,the extentof the tubularshare iscorrectedby using the following equation, derived from urine findingsin selectedpatientswith glomerulonephritiswhose renalinterstitialspace was devoid of major histopathological findings[21]: a1-microgbobulin (corr.) = e#{176}#{176}#{176}#{176}22 . .,lbumin tubulo-interstitial (A), 4.7 This the equation cluster estimation approximately of primary of the describes gbomerulopathies amount the lower in Fig. of tububo-interstitial margin 2 and of allows involvement in gbomerular diseases:Tubular proteinuriais assumed to result from tubularoverloadifthe correctedvalueof a1-microglobulin is <14 mg/g concentrations creatinine (text element 22). a,-Microgbobulin >14 mg/g creatinine are interpreted as showing an involvement of the renal interstitialspace in gbomerulone- phritis (text element 23). To differentiate acute from chronic tubular disorders in interstitial nephropathies, UPES requests data for the catalytic concentrationof the tubular enzyme p-NAG. In acute lesions (e.g., caused by nephrotoxic antibiotics), the excretion of p-NAG usuallyexceeds20 U/L ifa1-microgbobulinexcretionis >40 mg/g creatinine (text element 24) [12]. Chronic tububointerstitial excretion OUTPUT diseases without (FINAL are described a major by increased increase a,-microgbobulin of p-NAG. REPORT) UPES composes the finalreport from the selectedtextitems afterthe urine and serum proteinfindingshave been medically assessed. Clinical Chemistry 42, No. 8, 1996 EVALUATING THE VALIDATION SET KNOWLEDGE BASE WITH 1219 most (46, or 61%) of the 76 urines to the diagnosticgroup “primary or secondary glomerulopathy.” The excretion ratio for IgG/albumin misled the system in 3 of these 46 decisions to favor the primary type of glomerulopathy. The remaining 27 urines (36%) were classified as “renal dysfunction” because of the low quantitiesof marker proteinsexcreted. Finally, UPES interpreted the urine patterns of all 7 interstitial nephropathies correctly. THE To compare the medical interpretation of proteinuria by UPES, statistical methods and human expertise, we assessed the results of urine proteindifferentiation of the validationset(129 urines from 94 patients)as classified by IJPES, linear and quadratic discrimination fimctions, and four experts in our laboratory who were familiarwith thismethod of urine analysis. The resultsof these evaluationsare given in Table 3; misclassifIcations are summarized as “others.” Because there are no gold standards for evaluating urinary protein patterns,it was difficult to define correct and false interpretations. Patients with a documented diabeticnephropa- Discriminant functions. As an alternative classification method, we used the discriminantfunctionsestimated from the albumin, excretion. The patterns were describedby human experts and by the system as reflecting gbomerular and (or)tubulardysfunction, secondary gbomerulopathy, primary or secondary gbomerubopa- a,-microglobulin, and IgG patterns of the trainingset (no implausible constellations were included). Each protein pattern was classified to the diagnostic group having the highest group probability, as computed with linear and quadratic discriminant functions. Resubstitution of the trainingsetresultedin a reclassification rateof 75% by lineardiscriminantfunctionsand 79% thy, or mixed by quadratic discriminant functions. thy, for example, showed many different patterns of protein (gbomerubar and tubular) nephropathy, and all of these diagnostic groups were assumed to be a correct interpretation. Only the description “primary gbomerubopathy” would be judged a clearmisclassification of these patients. UPES. Of 46 urines from patients with gbomerubonephritis, UPES identified 9 primary gbomerubopathies (20%) by first-step classification. The correct but more global diagnosis “primary or secondary glomerulopathy” was chosen in the majority of cases(31 of 46 urines,67%) because of the overlappingzones of the albuminla,-microgbobulin patterns. Using the IgG excretion in a second-stage pattern classification correctly assigned 6 of these 31 ambiguous cases to the primary gbomerulopathy group. Two patientswith gbomerubonephritisand albuminuria >10 g/g creatininecould not be interpretedby UPES. Only 2 of 76 urines(3%) with secondary glomerulopathies were misclassified as primary glomerulopathies by UPES. Both of these urines showed substantial albuminuria (844 and 552 mg/g creatinine) and IgG excretion (63 and 59 mg/g creatinine) but no significant tubularproteinuria. Again, UPES assigned To allow consideration of an ambiguous classification, as in UPES, we took into account the differencebetween the two highest group probabilities. If this differencewas <0.3, the pattern was assigned to both classes(ambiguous classification). Linear discriminant functions described 38 samples (29%) of the validationsetas caused by “renaldysfunction”;68 patterns (53%) were interpretedcorrectlyas belonging to other diagnostic groups matching the known diagnosis. By quadratic discriminant functions,37 cases(29%) were classified as “renaldysfunction,” whereas other, correct diagnostic classes were chosen for 65 samples (50%). In total,there were 23(18%) vs 27 (21%) misclassifications by linear and quadratic discriminant functions, respectively (Table 3). Human greatly, experts. The quality of the human expertisevaried depending on the experience of each expert with urine protein differentiation. Generally, the humans interpreted more proteinuriasas being “renaldysfunction”than did UPES. Two experts more oftendecided on an unambiguous diagnosis,atthe Table 3. Diagnostic interpretation of urine protein differentiatIons of 46 prImary glomerulopathles, 76 secondary glomerulopathies, and 7 interstitIal nephropathies by UPES, linear and quadratic discrimlnant functions, and four experts. Clinical diagnosis Secondary GP PrimaryGP Expertise UPES Expert Expert Expert Expert LDF QDF a 1 2 3 4 Correct” TP Pulm.GP GP GP/TP Dys Others GP GP/TP Dys TP GP/TP Dys Others 9 31 1 3 2” 0 46 1 27 2” 6 0 1 0 2 19 0 22 22 22 41 18 38 8 12 12 1 6 5 9 1 0 2 3 3 5 5 2 0 0 0 2 6 10 0 0 11 5 11 13 43 32 30 17 15 11 0 0 1 9 0 0 32 34 32 39 33 35 1 10 2 6 17 17 5 5 6 5 7 5 0 0 0 2 0 2 1 0 1 0 0 0 1 2 1 0 0 0 diagnoses are listed (prim./sec.) GP = Sec.GP (primary/secondary) glomerulopathy, TP = tubulo-interstitial Others nephropathy, patterns interpreted as implausible constellations and urines not classified or misclassified are summarizedas Others. b 2 patterns not classified by UPES. “2 patterns classified LDF, linear discriminated by UPES as a primary glomerulopathy. function; QDF, quadratic discriminant function. or Dys = renal dysfunction, whereas Ivandi#{233} et al.: Urine 1220 risk of increasing preferred the their misclassifications; more general diagnosis the other “primary protein two experts or secondary glomerulopathy,” to be on the safe side. Notably, one expert reliedon a positiveglucoseteststripresultto classify a glomerubopathy as the secondary type. In contrast to UPES, he and two other expertsfailedto identifythe primary gbomerubopathy in a 32-year-old woman with IgA nephropathy and familial glucosuria. Discussion Evaluation with the validation data set showed that noninvasive urine proteindifferentiation may be a usefuldiagnosticstrategy in nephrology. The knowledge-based system UPES performed well in diagnostic interpretation of urine protein patterns, correctly distinguishing all interstitial nephropathies from gbmerulopathies. It misclassified only 2 of 129 urines (2%), incorrectlyconcluding that patternsof significant glomerular proteinuria had instead indicated a primary gbomerubopathy. Discriminant functionswere not able to deal properly with the overlapping zones of allclinicalclasses. The four human experts also had problems correctly classifying primary and secondary gbomerulopathies-which are difficult to distinguish by clinical chemistry means. After the evaluation,we adjusted the knowledge base of UPES to improve the medical assessment. We added one circle to the secondary glomerulopathy class so that this diagnostic group would be considered in cases of significant glomerular proteinuria.Another circlewas also added to the primary gbomerubopathy class to ascertain the identification of cases of excessive proteinuria. The addition of these two circles will help prevent misclassification in similarcases. Knowledge-based systems, as means of rationalization, accelerate the time-consuming process of medical assessment and increase the economic efficiency of a clinical laboratory. Such programs make possible consistent and standardized medical assessmentof constantand high quality, especially when dealing with the highly complex data produced in increasingly specialized areas [22-24]. Apart from learning effects, transparent data interpretation rather than simple “data intoxication” [25] may provide clinical physicians with useful additional information [26]. The knowledge-based system we designed provides for the first time a concise decision-supporting system to exclude and differentiate proteinuria, hematuria, and leukocyturia. Working with the complex excretion pattern of different marker proteins, UPES can distinguish prerenal, glomerular, tubulo-interstitial, and postrenal causes of pathological urine findings. By using two differentmethods for knowledge representation, we essentially implemented the strategyand experienceof a specialist in urine protein differentiation as a knowledge base. Modelling the framework of the knowledge base with if/then rules makes itpossibleto integratethe heuristicsthat guide a human expert in the diagnosticdecisionprocess.Rules allowthe designof a modular knowledge baseto maintain a clearstructure and facilitate regular update. Furthermore, the user can easily retrace the decisions formulated by the system. Diagnostic pattern classification in urine protein differentiation can be expert system (UPES) implemented in a rule bae by using constant thresholds to describe the different clusters by squares bike a mosaic. However,good resolutionforsufficient representationof the clusters isobtained only by using a largenumber of thresholds.Thus, the quality of classification is limited by the number of rules needed to compare the patternof the patientwith the margins of allclusters. Although thisiseasilydone in a two-dimensional pattern recognition, more dimensions increase the number and complexity of rules exponentially. Because rules, therefore, did not appear to be the optimal solution, we booked foralternative ways of knowledge representation. Classificatory discriminant analysis [27], for example, can designate and separate the different diagnostic groups in a statistical way, but several assumptions are necessary that are not always met (e.g.,mubtivariatenormal distributionof data). Moreover, a largersetof examples of allclassesisnecessaryto finddiscriminatingfunctionsthatare generallyvalid,and every change in this collective (e.g., adding a new patient not yet correctly classified) requires a complete recalculation. Nevertheless,we used the trainingset of urine protein patternsto estimateassociatedlinearand quadraticdiscriminantfunctions. Using these functionsto classifythe validationset,however, revealedmajor difficulties in dealingwith overlappingzones of the diagnostic groups. Another flexible tool used successfully in laboratory medicine forrobustpatternrecognitionisneuralnetworks [28-30].These models forknowledge-processingand representationare abbeto deal with complex, uncertain, and even incomplete data. In a self-organizing process they use the information contained in training data to build up and adjust their “knowledge.” After this dynamic learning process, the adapted network structure itself incorporates the knowledge base [31]. Quasi-parallel processing of data enables fastclassification in neural networks but also makes it difficult for users to influenceand understand their behavior. The successful training of these “black boxes” depends on theirarchitecture(i.e., number of neurons and layers). The lack of general rules for constructionmeans that finding the rightconfigurationof a neuralnetwork requiresmuch empirical testing. In designing UPES, we chose another way to simulate the diagnostic identification of marker patterns as an important part of the expert’s considerations. Geometric distance classification allows the system to recognize and separate quantitative multidimensional patterns [14]. Implemented in the flexible software tool GEODICLA 113], thisclassification method can describe and separatecomplex clustersin terms of spheroidsand ellipsoidswith straightand obliqueaxes.Information contained in a trainingsetisspecifically integratedand generalizedin a rapid automated learningprocess.In contrastto most neuralnetworks and statistical classification methods, the resultingrepresentativesalways guarantee a 100% reclassification ratewhen cbassifying the training collective. Multiple features such as mathematical preprocessing, several learning modes, and different ways of distance calculation help influence the self-organizing process and optimize its results. The geometric figures and their parameters can easily be adjusted and extended. A simple local modification of the geometric knowledge base, e.g., if a pattern 1221 Clinical Chemistry 42, No. 8, 1996 isnot yet correctlyclassified or isnot classified at all,adds new knowledge to a classification system. Updates of the knowledge base are thus facilitated. Geometric distance classification enables UPES to make robust and nonparamen-ic pattern recognitions. Further, the diagnostic classification can be elucidated by showing the circles/ellipses on the screen together with a symbol representing the patient’spattern.Thus, a user does not have to accept the UPES interpretation of the marker proteins as if it were a Greek oracle. The quality of a decision-supporting system for daily routine assessment such as UPES depends on easy and comfortable use of the system as well as the knowledge integrated being highly accurate and sufficiently extensive. Because widespread use of the system depends on its acceptanceby users,considerationsof comfort and safety have played a major role in its development. The complete integration of the knowledge-based system in the computer network structure of our laboratoryas webb as the automated data import and export minimizes errors during data transfer and contributes greatly to the comfortable and problem-free use of UPES in daily routine. Use of programming language C guaranteesthatmedical evaluationof the dataisnot time consuming: UPES takes2 s to compose the reports from a filecontaining data for 30 patients(the estimated average number of dailyrequests), using a Model 486 PC (33 MHz). Actually, >90% of the reports created by UPES are not modified. In the remaining cases, additional clinical information (e.g., known renaltransplant)isconsidered. Apart from these practicalaspects,the credibility and reliability of a decisionby implemented knowledge are an essential condition for the widespread use of an expertsystem,especially in medical fields. Evaluation with the validationset confirmed thatinterpretation of urine proteindifferentiation isa complex and difficult task sufficiently solved by UPES. Moreover, the evaluation results provided evidence that even experts can learn from a continually growing knowledge base of an expert system. Given that gold standards have yet to be defined for many of the observed protein patterns (e.g., “dysfunction”), future prospective studies may help improve the predictive qualities of the system. Consideration of additional clinical information, implementation of other urine results (e.g., microscopy), and extension to previous urine protein patterns are currentlyunder development. We conclude that urine protein differentiation in itspresent form issuperior to traditional urine analysis as a mirror of renal function [32] and is a valuableadditionto the morphological information provided by histopathobogy and medical imaging. Use of the decision-supportingsystem UPES for medical assessment of urine proteindifferentiation providesa standard of high and constant quality. A graduated and transparent decision process is implemented in a hybrid knowledge base that uses both production rules and geometric distance classification as complementary methods of knowledge representation.In the hands of a responsible physician, UPES can be a useful tool for increasing the efficiencyand qualityof a laboratory. References 1. Spackman KA, Conrrelly OP. Knowledge-based systems in laboratory medicine and pathology. Arch Pathol Lab Med 1987;111: 116-9. 2. Winkel P. The application of expert systems in the clinical laboratory. din Chem 1989:35:1595-600. 3. PesceAi, Boreisha I, Pollak VE. Rapid differentiation of glomerular and tubular proteinuria by sodium dodecyl sulfate polyacrylamide gel electrophoresis. Clin Chim Acta 1972;40:27-34. 4. Boesken WH, Kopf K, Schollmeyer P. Differentiation of proteinuria diseases by diskelectrophoretic molecular weight analysis of urinary proteins. Clin Nephrol 1973:1:311-6. 5. Petersen A, Evrin PE, Berggard I. Differentiation of glomerular, tubular and normal proteinuria: determinations of urinary excretion of $32-microglobulin, albumin and total protein. J Clin Invest 1969;48:1189-98. 6. Cameron JS,BlandfordG.The simple assessment of selectivity in high proteinuria. Lancet 1966;i:242. 7. Hofmann W, Guder WG. A diagnostic programme for quantitative analysis of proteinuria. J CIin Chem Clin Biochem 1989:27:589- 600. 8. Hofmann W, Rossm#{252}ller B, Guder WG, Edel HH. A new strategy for characterizing proteinuria and haematuria from a single pattern of definedproteins in urine. EurJ ClinChem ClinBiochem 1992:30: 707-12. 9. Hofmann W, Schmidt 0, Guder WG, Edel H. Differentiation of hematuria by quantitative determination of urinary marker proteins. Kim Wochenschr 1991;69:68-75. 10. Guder WG, Hofmann W. Differentiation of proteinuria and haematuna by single protein analysis in urine. Clirr Biochem 1993:26: 277-82. 11. Hofmann W, Sedlmeir-Hofmanrr C, lvandi M, Schmidt 0, Guder WG, Edel H. Assessment of clinically characterized of urinary.protein patterns patients. Typical examples on the basis with reports. Lab Med 1993;17:502-12. 12. Schmidt 0, Hofmann W, Guder WG. Adaptation of the diagnostic strategy of urine protein differentiation to the Hitachi 911 analyzer. Lab Med 1995:19:153-61. 13. lvandi#{227} M. Entwicklung und Evaluierung eines wissensbasierten Befundungssystems zur Urineiwei8differenzierung [Dissertationl. M#{252}nchen: Ludwig-Maximilians-Universitat, 1995. 14. Barschdorff D, Bothe A. Signal classification using a new selforganising and fast converging neural network. Noise Vibration 1991;9:11-9. 15. Itoh Y, Enomoto H, Takagi K, Kawai T. Clinical usefulness of serum a1-microglobulin as a sensitive indicator for renal insuffi- ciency. Nephron 1983;33:69-70. 16. Weber MH, VerwiebeR.a1-Microglobulin (protein HC):featuresof a promisingindicator of proximaltubulardysfunction. Eur J Clirr Chem Clin Biochem 1992;30:683-91. 17. Jung M, Jung K. Low-molecular-mass proteins in serum as markers of glomerular filtration rate: cystatin C, a1-microglobulin and p2mrogloi Lab Med 1994;18:461-5. 18. Boege F,KoehlerB, LiebermannF.Identification and quantification of Bence-Jones proteinuria by automated nephelometric screening. J dIm Chem Clin Biochem 1990;28:37-42. 19. Birch OF, Fairley KF. Haematuria: 1979;ii:845-6. glomerular or nonglomerular? 20. K#{227}hler H, Wandel E, Brunck B. Acarrthocyturia-a characteristic marker for glomerular bleeding. Kidney Int 1991;40:115-20. 21. Hofmann W. A mathematical equation to discriminate overload proteinuria from tubulo-interstitial involvement in glomerular diseases. Clin Nephrol 1995;44:28-31. 22. Keller H,Trendelenburg C, eds.Clinical biochemistry data presentation and interpretation. Berlin: de Gruyter, 1989. 1222 Ivandi#{233} et ab.:Urine proteinexpertsystem (UPES) 23. Bepperling C, Hehrmann R, Haas H, Hotz G, Olbricht T, Schmidt R, et al. A knowledge-based system for the interpretation ofthyroid hormone measurements: evaluation and optimisation of the system Pro.M.D.-SD in five clinical laboratories. Lab Med 1994; 18:564-71. 24. TrendelenburgC, PohI B. Pro.M.D. expert system and itsapplication in laboratory medicine.Ann Biol Clin 1993:51:226-7. 25. O’Moore RR. Decision-supporting based on laboratory data. Methods Inform Med 1988;27:187-90. 26. WmnkelP. Interpreting the results is the expertise of the laboratory. Clin Chim Acta 1994;224:S9-S51. 27. SolbergHE. Discriminant analysis. CritRev dIm Lab Scm 1978;9: 209-42. 28. lvandk BT, Kratzer MA.A, Fateh-Moghadam A. Analysisof serum electrophoresis pattern by artificial neural networks. Lab Med 1992:16:128-33. 29. Furlong JW, Dupuy ME, Heinsimer JA. Neural network analysis of serial cardiac enzyme data-a clinical application of artificial machine intelligence. Am J dIm Pathol 1991:96:134-41. 30. Reibnegger G, Weiss G, Wachter H. Self-organizing neural networks as a means of cluster analysis in clinical chemistry. Eur J dIm Chem dIm Biochem 1993:31:311-7. 31. McClelland JL, Rumelhart DE. Explorations in parallel distributed processing. Cambridge, MA: MIT Press, 1989. 32. Hofmann W, Regenbogen C, Edel H, Guder WG. Diagnostic strategies in urinalysis. Kidney mt 1994:46(47, Suppl):111S-4S. Appendix: Text Elements Selected by UPESto Compose a LahOFatOIY Report 1. Based on the serum findings,a major decrease of glomerular filtration rate is not likely. 2. The glomei-ular filtration rate is reduced. 3.An isolatedincreaseof both serum valuesin combination with normal urine protein excretion might reflect a boss of functioning nephrons. The protein reabsorption is fully compensated by the remaining nephrons. An active renal disease is unlikely. 4.To exclude the possibility of a reduced GFR, gbomerular clearanceshould be investigated. 5. The isolatedincreaseof serum creatininemight indicate so-called pseudocreatinines.Alternatively,increased muscle mass or a meat diet may be involved. 6. Discrepancy between the sum of albumin, IgG, and a, -microglobubin and the concentration of total protein (single proteins/total protein <0.3) in combination with a positive test-strip result for blood indicates a prerenab hematuria. Definite report follows after additional tests to exclude myogbobinuriaor hemogbobinuria. 7. Differentiationof renal and postrenal hematuria by protein analysisisimpossibleat albumin concentrations<100 mgfL. Phase-contrast microscopy of a fresh morning urine may allow the differentiation of renal and postrenal causes of hematuna (acanthocytes?). 8. Most likely,postrenab hematuria is present. Because additionalrenal excretion of proteins cannot be excluded, a control after disappearance of hematuria issuggested. 9. Most likely, renal(glomerular/tububo-interstitial) hemaispresent.A slightadditionalpostrenalsource of erythro- tuna cannot be excluded. 10. The detection of beukocyte cytes possible postrenal with leukocytes. inflammation esterase or contamination may indicate a of the urine 11.The urineproteindifferentiation should be repeatedafter leukocyturia has stopped, because inflammations in the lower urinary tract can also cause a slight proteinuria. 12. The detection mation with renal of leukocyte involvement, esterase may indicate inflamif there was no leukocyte contamination during sampling. 13. Analyses of the marker proteins in the urine do not indicateany dysfunction of gbomerular protein filtration and tubular reabsorption. No signs of hematuria or granulocyturia are present. 14.An isolatedincreaseof IgG may indicate,e.g.,monocbonab gammopathies. 15. Discrepancy between the sum of albumin, IgG, and a, -microglobulin and the concentration of total protein (single proteins/total protein <0.3) indicatesa prerenal proteinuria. Immunofixation will be performed to exclude Bence Jones proteinunia. The definitive reportwillfollow afterthisinvestigation. 16.A distinctselective glomerular proteinuriawith simultaneous slight tubular 17. The permeability proteinuria is found. findings are consistent or a tububo-interstitial with impaired gbomerular dysfunction (or both). A slight increase of the marker proteins does not necessarily indicatea renal disease.If clinical cues are missing,a control measurement made under standardizedconditions(no intense physical stress before investigation, optimal metabolic and hypertonic equilibrium of diabetic and hypertonic patients) is recommended. 18. The findingsare consistentwith a tubulo-interstitial nephropathy/primary glomerubopathy/secondary glomerubopathy. 19.The findingsare consistentwith a primary or secondary glomerubopathy (e.g., diabetes mebbitus, hypertension). 20. The findings are consistent with either (a) a glomeru-. bopathy with impaired tubulo-interstitiab reabsorption or (b) an interstitial nephropathy with secondary glomerulopathy. 21. The IgC excretion indicates a primary glomerulopathy/ secondary glomerubopathy/tubulo-interstitiab nephropathy. 22. The increased excretion of the tubular marker a,microglobubinisthe resultof a tubularoverload (exhaustionof the tubularreabsorptivecapacity). 23. The extent of interstitial fibrosis correlates with the excretionof the tubularmarker proteina,-microglobubin. 24. The increased excretion of the tubular enzyme (3-NAG indicates a possible acute disorder of proximal tubular cells.