Published ahead of print on December 12, 2002, doi:10.1164/rccm.200208-855OC
© 2003 American Thoracic Society
Significant Microbiological Effect of Inhaled Tobramycin in Young Children with Cystic FibrosisDepartment of Pediatrics, Children's Hospital and Regional Medical Center/University of Washington, Seattle, Washington; Department of Pediatrics, University of Colorado, Denver, Colorado; Department of Pediatrics, Baylor College of Medicine, Houston, Texas; Department of Pediatrics, Stanford University, Palo Alto, California; Department of Pediatrics, Case Western Reserve University, Cleveland, Ohio; Department of Pediatrics, University of North Carolina, Chapel Hill, North Carolina; Department of Pediatrics, Harvard University, Boston, Massachusetts; Department of Pediatrics, University of Cincinnati, Cincinnati, Ohio; Department of Pediatrics, Johns Hopkins University, Baltimore, Maryland; and Cystic Fibrosis Therapeutics Development Network, Cystic Fibrosis Foundation/University of Washington, Seattle, Washington Correspondence and requests for reprints should be addressed to Ronald L. Gibson, M.D., Children's Hospital and Regional Medical Center, 4800 Sandpoint Way NE, Mail Stop 3D-4, P.O. Box 5371, Seattle, WA 98105-0371. E-mail: ron.gibson{at}seattlechildrens.org
We conducted a double-blind, placebo-controlled, multicenter, randomized trial to test the hypothesis that 300 mg of tobramycin solution for inhalation administered twice daily for 28 days would be safe and result in a profound decrease in Pseudomonas aeruginosa (Pa) density from the lower airway of young children with cystic fibrosis. Ninety-eight subjects were to be randomized; however, the trial was stopped early because of evidence of a significant microbiological treatment effect. Twenty-one children under age 6 years were randomized (8 active; 13 placebo) and underwent bronchoalveolar lavage at baseline and on Day 28. There was a significant difference between treatment groups in the reduction in Pa density; no Pa was detected on Day 28 in 8 of 8 active group patients compared with 1 of 13 placebo group patients. We observed no differences between treatment groups for clinical indices, markers of inflammation, or incidence of adverse events. No abnormalities in serum creatinine or audiometry and no episodes of significant bronchospasm were observed in association with active treatment. We conclude that 28 days of tobramycin solution for inhalation of 300 mg twice daily is safe and effective for significant reduction of lower airway Pa density in young children with cystic fibrosis.
Key Words: bronchoalveolar lavage lung Pseudomonas Morbidity and mortality in patients with cystic fibrosis (CF) are primarily attributable to progressive obstructive pulmonary disease in conjunction with chronic Pseudomonas aeruginosa (Pa) endobronchial infection and an intense neutrophilic inflammatory response (1). Moreover, among young children with CF, increased morbidity and mortality are observed in association with early Pa infection (2, 3). The prevalence of Pa infection increases with age, with positive respiratory tract cultures reported for up to 30% of infants, 3040% of children 210 years of age, and 6080% of adolescents and adults with CF (4). Chronic Pa infection results in a mucoid bacterial phenotype and may form biofilms that are more refractory to treatment (57). Appropriate intravenous or inhaled antibiotic therapy for chronic Pa endobronchial infection results in significant clinical improvement, but the reduction in lower airway Pa density is only 2 log10-fold on average and eradication of Pa is rare (810). In contrast to chronic Pa infection, characteristics of early Pa infection are more favorable for eradication with early intervention. Young children with CF and initial infection have reduced Pa density in the lower airways, lower rates of mucoid Pa isolation, and less antibiotic resistance relative to patients with established infection (1113). Aggressive antimicrobial treatment of initial Pa infection in children with CF has achieved eradication of Pa or delayed chronic Pa infection of the upper respiratory tract (1418). Limitations of these prior studies include the lack of controls or use of historical controls, no evaluation of lower airway microbiology or lower airway inflammation, small sample sizes, and lack of focus on safety. Only one published study of early intervention included a control group (14). Only one uncontrolled study evaluated treatment of initial lower airway Pa infection diagnosed by bronchoalveolar lavage (BAL) (18), despite the poor predictive value of upper airway cultures for identifying lower airway pathogens in CF (1921). The need for controlled studies is highlighted by reports of transient Pa infection in young children with CF (12). Safety and emergence of resistant pathogens with aggressive early intervention directed against Pa are a concern for young children with CF, and avoidance of oto- and nephrotoxicity is especially important in this age group. Inhaled antipseudomonal antibiotics, in particular aminoglycosides, can deliver high antibiotic concentrations directly to the lower airways with limited systemic absorption (10, 22, 23). Two Phase III clinical trials demonstrated a 1.6 log10-fold reduction in sputum Pa density and improved FEV1 (12% treatment effect compared with placebo) after 28 days of treatment with tobramycin solution for inhalation (TSI) (TOBI; Chiron, Emeryville, CA), 300 mg twice daily (10). However, these trials did not include children less than 6 years of age, who cannot reliably expectorate sputum or perform lung function tests and for whom other established clinical outcome measures are lacking. We reported that a single 300-mg TSI dose administered to children with CF and younger than age 6 years was safe and produced therapeutic lower airway concentrations of tobramycin (24). The Cystic Fibrosis Therapeutics Development Network conducted a double-blind, placebo-controlled, multicenter, randomized trial to test the hypothesis that administration of TSI (300 mg twice daily for 28 days) to children with CF and less than 6 years of age would result in a significant antimicrobial effect, including possible eradication of Pa from the lower airway, and would be safe. Some of the results of this study have been previously reported in the form of an abstract (25).
Study Design The trial was conducted between February 2000 and May 2001 at nine centers. The study was approved by each center's Institutional Review Board. Written informed consent was obtained for enrolled patients. Inclusion criteria for enrollment were as follows: age, 6 months or more and less than 6 years; diagnosis of CF; and one historical oropharyngeal (OP) culture positive for Pa within 2 weeks to 12 months before screening (see the online supplement for exclusion/withdrawal criteria). Patients with Pa-positive OP cultures at screening were eligible for bronchoscopy and baseline BAL, performed according to Cystic Fibrosis Therapeutics Development Network standard operating procedures (see the online supplement). Baseline evaluation included physical examination, modified Shwachman score (maximum score of 75, no radiograph score), chest radiograph if none in prior 3 months or clinically indicated before BAL, OP culture, and blood draw for complete blood count with differential, serum creatinine, Pa exotoxin A serology, urea, and cytokines. Patients with a Pa-positive baseline BAL culture (detection of Pa at any density) were randomized (1:1) to receive TSI (300 mg) or placebo twice daily for 28 days at home. The first dose was administered on Day 0 (less than 10 days after BAL). Randomization was stratified by study center and age (36 months or less, or more than 36 months). Other inhaled antibiotics were restricted until study completion. Study visits on Days 14, 28, 42, and 56 included clinical evaluation and OP culture. On Day 14, blood was obtained for determination of trough and peak tobramycin concentrations, serum creatinine, complete blood count with differential, and serology. On Day 28 (± 2 days), BAL in the same lobar segment plus baseline tests and procedures were repeated (except radiography).
Study End Points
Laboratory Studies Tobramycin concentrations in Day 28 BAL samples were measured by Chiron (Seattle, WA), using high-pressure liquid chromatography (lower limit of quantitation, 0.4 µg/ml) (27). Concentrations of bioactive tobramycin in Day 28 BAL samples were determined by the Microbiology Core via bioassay procedure (24). A subset of baseline BAL samples served as controls. An in vitro Pa viability assay mimicking BAL shipping conditions was performed by the Microbiology Core to determine whether negative cultures on Day 28 were due to residual tobramycin in BAL fluid. Pa isolates were genotyped by a random amplified polymorphic DNA polymerase chain reaction technique (28, 29). BAL cell counts were performed at each center. The network's Cytology Core (Case Western Reserve University, Cleveland, OH) performed differential counts on stained slides. BAL and plasma urea and inflammatory mediator assays were performed by the network's Inflammatory Mediator Core (University of Colorado, Denver, CO). Concentrations reported for BAL samples were corrected for dilution, using urea as a marker (30). Serum exotoxin A titers were tested by the Microbiology Core, using an indirect microtiter enzyme-linked immunosorbent assay (11).
Safety Monitoring
Statistical Analysis
Patient Overview and Demographics Although the planned sample size was 98 patients, the trial was stopped early by the Data Monitoring Committee after interim analysis of data from the first 21 randomized patients showed a statistically significant microbiological treatment effect. This decision also prevented the exposure of additional patients receiving placebo to the risks of bronchoscopy. At the time the trial was stopped, 113 patients had been screened at 9 participating centers. Among screened patients, 37 qualified for baseline bronchoscopy with BAL, of whom 21 were positive for lower airway Pa and were randomized into the study (13 to placebo and 8 to TSI). All randomized patients completed the study. Of the 21 randomized patients, 6 were younger than 36 months of age. Treatment groups were fairly similar with regard to patient demographic and clinical characteristics at baseline, as shown in Table 1 . Adherence to study drug was good for both groups based on comparing the counts of returned drug ampules as a surrogate for doses administered; the mean number of doses was 53.2 (SD 6.7) for the placebo group and 54.5 (SD 4.1) for the TSI group.
Lower Airway (Bronchoalveolar Lavage) Pa Density Pa was isolated at similar densities from placebo and TSI group patients at the baseline BAL (Table 2) . The mean reduction in Pa density in the TSI group between baseline and Day 28 was 5.25 log10 CFU/ml, whereas the placebo group had a mean increase in Pa density of 0.30 log10 CFU/ml, for an observed difference in means between treatment groups of 5.55 log10 CFU/ml (Table 2). The difference between treatment groups, adjusting for the stopping rule, was 5.36 log10 CFU/ml (95% CI, 3.52 to 7.54; p < 0.0001). There was also a significant difference between treatment groups in the frequency of eradication at the Day 28 BAL (p < 0.0001), with Pa eradicated in 8 of 8 (100%) patients in the TSI group (one-sided 95% CI, 0.69 to 1.00) compared with eradication in only 1 of 13 (7.4%) placebo patients (95% CI, 0.002 to 0.36). These results, combined with the ethical considerations related to performing invasive bronchoscopy procedures in additional placebo patients, served as the basis for the Data Monitoring Committee decision to stop the study early.
The time between date of first positive culture for Pa (determined by medical record review) and date of randomization was longer on average in the placebo group (Table 2), and for a number of patients the study setting did not represent initial Pa isolation. Four placebo group patients and five TSI group patients had mucoid Pa isolated from their baseline BAL.
Tobramycin Concentrations in Day 28 Bronchoalveolar Lavage Samples Notably, all Day 28 BAL samples from the TSI group had detectable tobramycin concentrations by two different methods (Figure 1) . Concentrations observed in the TSI group were comparable when measured by bioassay or high-pressure liquid chromatography (Figure 1). The adjusted urea concentrations measured by chromatography in the TSI group, which provide an estimate of tobramycin concentrations in the epithelial lining fluid (ELF), were as follows: 8.2, 24.1, 36.8, 53.6, 98.1, 104.0, 119.0, and 145.8 µg/ml. All Day 28 BAL samples from the placebo group had undetectable tobramycin levels by both methods, as did five baseline BAL samples used as controls.
Four TSI group patients had their Day 28 BAL performed less than the stipulated 12 hours after the last dose of study drug. However, there was no clear relationship between measured BAL tobramycin concentrations and the length of time between last dose of study drug and start of the Day 28 BAL (Figure 1). We performed an in vitro experiment to determine whether exposure of Pa isolates to tobramycin concentrations present in Day 28 BAL fluid might have affected the viability of Pa from the TSI group patients during overnight shipping on ice. Among TSI group patients, the median time duration from collection of the Day 28 BAL sample to receipt at the Cystic Fibrosis Therapeutics Development Network Microbiology Core was 23 hours (range, 3 to 28 hours). All distinct morphotypes isolated at baseline from the eight TSI group patients were studied; after 24 hours of incubation at 4°C, there was a less than 1 log10-fold change in total Pa density for all eight patients. After 48 hours of incubation, there was a less than l log10-fold reduction in total Pa density for six of the TSI patients, and a maximum 2 log10-fold reduction was observed for the remaining two patients. We also examined qualitative culture results from aliquots of Day 28 BAL fluid that were processed at the site clinical laboratory. These specimens were not shipped and therefore were exposed only briefly to study drug before processing. No Pa was detected in 7 of 8 TSI group patients compared with 2 of 13 placebo group patients, which is similar to results obtained for the BAL samples shipped to the network's Microbiology Core.
Oropharyngeal Cultures
Among patients receiving placebo, four had negative OP results at baseline and/or Day 28 BAL that were discordant with their concurrent Pa-positive lower airway culture results. Five placebo group patients received antipseudomonal antibiotics (oral/inhaled) during the study (Figure 2B, top): one patient (receiving ciprofloxacin before screening and throughout the study) had Pa isolated from all available OP cultures; four patients (started on antipseudomonal antibiotics after the Day 28 BAL) had negative OP cultures on Day 42, but cultures on Day 56 were positive in two of three patients tested. Eight of 13 placebo group patients received no antipseudomonal antibiotics between baseline and Day 56 (Figure 2B, bottom); 5 were Pa positive for all OP cultures and 3 were Pa positive for all but one OP culture.
Pa Serology
Genotyping of Pa Isolates Genotyping was performed on each distinct Pa morphotype isolated at baseline (OP or BAL) and at subsequent visits (OP only) for the two patients in the TSI group who had recurrence of upper airway Pa at the Day 42 or Day 56 visit (see Figure E1 in the online supplement). The first patient had four BAL isolates and two OP isolates at baseline, with one OP isolate identified on Day 42 and two OP isolates on Day 56; all isolates were the same genotype. The second patient had one BAL isolate and one OP isolate at baseline, with two OP isolates on Day 56; all isolates were the same genotype.
Epithelial Lining Fluid Inflammatory Markers
Plasma Inflammatory Markers The 28-day change in peripheral white cell count was 1.7 x 106/ml (SD 1.5) in the TSI group and 0.3 x 106/ml (SD 3.3) in the placebo group, for a mean difference between groups of 2.0 x 106/ml (95% CI, 4.19 to 0.25; p = 0.08). For peripheral neutrophil count, the 28-day change was 1. 4 x 106/ml (SD 1.7) in the TSI group and 0.5 x 106/ml (SD 3.0) in the placebo group for a mean difference of 1.9 x 106/ml (95% CI, 4.09 to 0.30; p = 0.09). Sixty-four percent of the values of plasma interleukin-6 were below the lower limit of detection, and therefore descriptive statistics are not provided.
Clinical Parameters
Adverse Events and Other Safety End Points There were 107 treatment emergent adverse events, 72 among the 13 placebo group patients, and 35 among the 8 TSI group patients. Treatment emergent adverse events considered to be related to study drug were reported for four patients in the placebo group (six events) and two patients in the TSI group (five events). The rate of occurrence of specific adverse events was similar between treatment groups. Cough was the most common adverse event in both groups, affecting 92% of placebo patients and 88% of TSI patients. There were no episodes of bronchospasm related to study drug. Two patients had a serious adverse event related to bronchoscopy. One patient had transient vomiting and unsteady gait after lorazepam sedation that required hospitalization and overnight observation. A second patient had an acute episode of laryngospasm and hypoxemia as the bronchoscope was introduced into the airway and required intubation; a chest radiograph showed acute bilateral upper lobe atelectasis. The patient stabilized rapidly but was kept on minimal ventilatory support overnight as a precaution. The patient, who was not randomized to study drug, completed a 14-day course of intravenous antipseudomonal antibiotics and was stable on discharge from the hospital. For the remaining subjects, the most common adverse events related to bronchoscopy were transient cough and fever of mild to moderate intensity. Adverse events reported as definitely or probably related to bronchoscopy occurred in 8 of 13 placebo group patients and in 5 of 8 TSI group patients. The Day 14 peak (1 hour) serum tobramycin concentration for the TSI group was 1.0 ± 0.4 µg/ml and the trough concentration was 0.4 ± 0.5 (mean ± SD). There was no detectable serum tobramycin among placebo group patients. Serum creatinine levels were within the normal range for both groups at all evaluations (data not shown). There were no changes in auditory threshold in the TSI group.
The distribution of tobramycin MIC concentrations for OP Pa strains was determined at each study visit (data not shown). For placebo patients, MICs for OP Pa isolates were fairly stable over time from the baseline visit through Day 56 (majority less than 2 µg/ml, all less than or equal to 4 µg/ml). For the TSI group, all but one Pa isolate had an MIC
Tobramycin MICs for lower airway Pa isolates from the baseline BAL were comparable in the two treatment groups, and tobramycin MICs for concurrent OP and BAL Pa isolates were similar (data not shown). There were no tobramycin-resistant isolates among TSI group patients at baseline. The placebo group had similar tobramycin MICs for isolates from baseline and Day 28 BAL cultures (data not shown). One placebo patient had a tobramycin-resistant Pa isolate (MIC = 16 µg/ml) at baseline BAL; on Day 28 that individual had a lower airway isolate with MIC Quantitative BAL cultures on Day 28 showed no evidence of emergence of new CF pathogens in either treatment group. Five of eight TSI group patients had coinfection with Staphylococcus aureus at baseline; three of these patients had no detectable S. aureus on Day 28. No patients in the TSI group had any gram-negative organisms on Day 28. Five of 13 placebo group patients had coinfection with S. aureus or Haemophilus influenzae at baseline and Day 28.
We conclude that 28 days of TSI treatment (300 mg twice daily) compared with placebo results in a markedly greater reduction in Pa density in the lower airways and a higher frequency of eradication (as defined by no detectable Pa in culture). The observed antimicrobial treatment effect is more profound than that reported in older, chronically infected patients (10). This is the first placebo-controlled trial showing Pa eradication from the lower airways in patients with CF. This dramatic effect may be due to characteristics of the Pa colonizing younger patients (i.e., more susceptible to tobramycin, less mucoid), lower Pa densities, or slower tobramycin clearance from the lower airways of younger patients. Interpretation of these results is complicated by the unexpected finding of therapeutic tobramycin concentrations in the Day 28 BAL fluid. However, substantial data corroborate the validity of our primary efficacy end point. First, the bactericidal activity of aminoglycosides depends on active transport (40) and cellular division (41), which are both markedly inhibited at 04°C. Our in vitro studies demonstrated that the concentration of tobramycin in the Day 28 BAL fluid did not eradicate any patients' isolates, with Pa densities reduced 2 log10-fold or less under the conditions of specimen shipping. Second, the Day 28 BAL cultures from local site laboratories, with timely dilution and plating, yielded nearly identical results for the frequency of eradication in the two groups. Third, we observed sustained eradication of Pa from OP cultures through Day 56 in six of eight patients in the TSI group. No significant safety concerns were observed for TSI in these young children with CF based on adverse events, serum tobramycin concentrations, renal function, audiology testing, tobramycin MICs, and lack of emergence of new pathogens. Conclusions related to safety are limited by the small sample size and potentially insensitive measures of renal toxicity (42). Interpretation of secondary end points was made difficult because of the small sample size resulting from the study being stopped prematurely by the Data Monitoring Committee. The young children enrolled in this study had marked lower airway inflammation at baseline, consistent with prior studies of young, infected patients with CF (12, 13, 43, 44) and stable pediatric and adult patients with mild lung disease (45, 46). Factors that may have contributed to the lack of observed antiinflammatory effects of TSI include the degree and duration of Pa infection at baseline, the short treatment duration and follow-up, and in-fection undetected by lobar BAL (47). Alternatively, the robust inflammatory response in young patients infected with Pa may be, at least in part, intrinsic to the defect in CF (48). The preliminary observation of a greater rate of conversion to negative exotoxin A titers by Day 28 in the TSI group compared with the placebo group requires further study. The 28-day change in peripheral white cell count and neutrophil count, and the 56-day change in the modified Shwachman physical examination subscore were in the direction of a treatment benefit; however, our precision was too low to be highly confident that similar results would be obtained with a larger study. The lack of observed effects for other clinical parameters may have been attributable in part to the insensitivity of the chosen outcome measures. In patients with CF who are older than 6 years of age, peak sputum tobramycin concentrations occur 10 to 60 minutes after tobramycin inhalation (37, 38) with an estimated half-life in sputum of 2 hours or less (3739). In contrast, we observed that ELF tobramycin concentrations 4 to 24 hours after the last dose of TSI had no relationship to the interval since last dose, and were comparable to those observed 45 minutes after inhalation of a single dose (24). Possible explanations for the apparent delayed tobramycin clearance from ELF in young children with CF include (1) reduced cough clearance; (2) increased distal deposition and binding to macromolecules (49, 50), possibly due to reduced amounts of central airway purulent secretions; (3) drug accumulation in the lower airways after chronic exposure compared with single dose exposure (3739); and (4) sampling of distal lower airway secretions rather than sputum. If confirmed, this observation may influence dosing interval for TSI treatment in young children with CF. Prior studies treating initial Pa infection in CF have varied widely in the age of the patient population, the site of respiratory tract cultures (OP, endolaryngeal, sputum, and BAL), the presence of serum antibodies against Pa at enrollment, the duration of Pa infection before treatment, the treatment regimen, and the study end points (1418). Previous intervention trials for early Pa infection, although limited by lack of controls, lack of safety data, and focus on upper airway cultures, have consistently demonstrated a microbiological effect. The observed differences in the duration of eradication are likely dependent on patient selection criteria, treatment regimens, and outcome measures. Munck and coworkers treated first Pa (nonmucoid) colonization in young children with intravenous antibiotics for 21 days and inhaled colistin for 2 months and reported transient eradication of Pa for a mean duration of 8 months (17). The majority of these patients were recolonized with a new Pa genotype. We observed eradication of both mucoid and nonmucoid Pa from both BAL and OP cultures at the end of TSI treatment in all eight patients, with recurrent Pa of the same genotype in OP cultures from two patients by Day 56. Potential sources include the sinuses, undetected residual lower airway infection, or reinfection with the same environmental isolate. We have no data on the time to recurrence of Pa infection in the lower airways. In summary, the accumulating data suggest that early antipseudomonal therapy can eradicate both upper and lower airway Pa colonization. Unfortunately, compelling evidence of a clinical benefit from early intervention is lacking (15, 18, 51). Often these young patients with early Pa infection have minimal symptoms with normal lung function. (12, 16) This highlights the need for better clinical outcome measures for young children, such as raised volume chest tomography to assess early bronchiectasis (52), or raised volume infant lung function tests to detect air trapping and reduced small airway flows (53, 54). Future early intervention trials should focus on safety, determine the minimal amount of antipseudomonal therapy required for sustained Pa eradication, and characterize the host and environmental factors that result in recurrence of Pa infection. Ultimately, we recommend a placebo-controlled trial, with a primary clinical end point, for treatment of first isolation of P. aeruginosa.
The authors thank the patients and families who participated in the clinical trial, and they wish to recognize the efforts of the other members of the Cystic Fibrosis Therapeutics Development Network Study Group (Morty Cohen, Jessica Foster, Charlene Hallmark, Trish Hasbrouck, Jay Hilliard, Kate Hilliard, Lori Ingham, Craig Johnson, Vikki Kociela, Richard Kronmal, Sally Locke, Jean Mundahl, Iris Osberg, Churee Penvari, Jenny Stapp, Sharon Watts, Marcia Wertz, and Judy Williams). A special thanks to Robert Beall, Preston Campbell, and Judy Vaitukaitis for their support and dedication to the Cystic Fibrosis Therapeutics Development Network.
Supported by the National Institutes of Health (1 RO1 DK 57755-01 and 1 RO1 DK 57755-01-02), the Food and Drug Administration (FD-R-001695-01), the Cystic Fibrosis Foundation, and Chiron Corporation. Also supported by the General Clinical Research Centers Program, NCRR, NIH (grants MO1-RR00037, RR00046, RR00052, RR00069, RR00070, RR00080, RR00188, RR02172, and RR08084). This article has an online supplement, which is accessible from this issue's table of contents online at www.atsjournals.org
* Members of the Cystic Fibrosis Therapeutics Development Network Study Group: Morty Cohen, Jessica Foster, Charlene Hallmark, Trish Hasbrouck, Jay Hilliard, Kate Hilliard, Lori Ingham, Craig Johnson, Vikki Kociela, Richard Kronmal, Sally Locke, Jean Mundahl, Iris Osberg, Churee Penvari, Jenny Stapp, Sharon Watts, Marcia Wertz, and Judy Williams. Received in original form August 12, 2002; accepted in final form November 19, 2002
This article has been cited by other articles:
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||