What the Critics Say: E. The NCI position on CCDRT, based largely on the Gazdar/Shaw studies in lung cancer

The NCI (along with Cortazar and Johnson, in their review) has taken the position that the use of these assays is to be considered investigational. This position is not based on an examination the relevant literature reviewed in in the present paper, but appears to be based entirely on a series of highly-flawed studies published by the NCI lung cancer group (JNCI 82:117,'90; J Cell Biochem 24:173,'96; Clin Cancer Res 3:741,'97).

I am very familiar with these three studies, which had their origins in a parking lot conversation which I had with Dr. John Minna at the San Diego ASCO meeting in the early 80s.

Although I have tremendous respect for the above investigators and great appreciation for their efforts over the years, it must be noted that this body of work suffers greatly from a number of problems which are not relevant the application of these assays in clinical practice today and which are, more importantly, not applicable to the data which exist to justify the use of these assays in clinical practice today (see Part I).

The NCI's three studies were in (1) extensive stage small cell lung cancer, (2) advanced non-small cell lung cancer, and (3) limited stage small cell lung cancer. Study # 1 (JNCI 82:117,'90) can be described as being modestly "positive." Study # 3 (Clin Cancer Res 3:741,'97) can be described as being highly "positive." However, study # 2 in non-small cell lung cancer (Cancer Res 53:5181,'93; J Cell Biochem 24:173,'96) was certainly highly "negative."

As the NSCLC study was, by far, the most "negative" of the three, and it is worth considering in some detail, to illustrate the problems with drawing the conclusion that the "efficacy" of DST-directed therapy has been adequately tested and has been found wanting. I apologize in advance for the detailed complexity of the following critique, but it is extremely important to understand how irrelevant this study was to the use of CCDRT in the clinical management of cancer patients.

Shaw, et al studied assay-directed therapy of NSCLC. The Methods section (Cancer Res 53:5181, '93) stated that the assay "results included in this report were performed on fresh tumor tissue." This statement was added by the authors to the Methods section after I reviewed a pre-publication draft of this paper and noted the problems with testing sub-cultured cells (described below). In point of fact, the description in the Methods was incorrect and none of the results were performed on fresh tumor tissue. All assays were, in fact, performed on short-term cell lines (i.e. subcultured cells), which had at least one and often more passages in vitro. I confirmed this by speaking with Dr. Adi Gazdar (who was the investigator who actually performed the assays) and, in fact, the authors confirmed this with their own words in the Discussion section of the paper, in which they stated "subculturing also specifically excluded fibroblasts and benign epithelial cells."

This is very important, as the assay used by the NCI was designed (by me) to be a "total cell kill" (apoptotic) assay and not an antiproliferative assay. All of the drug concentrations and assay conditions were designed for fresh tumors and to test the total (largely non-dividing) tumor cell population. This endpoint is much more robust for specific cell killing mediated through apoptosis than are cell proliferation assays which measure non-specific growth inhibition effects. Once you start working with passaged, short-term cell lines, you begin to measure tumor cell subpopulations and you begin to measure antiproliferative effects along with the more specific apoptotic effects. All of the other investigators who have reported excellent correlations with total cell kill assays (more than 1600 published assay/treatment clinical correlation in all with these assays) have used true fresh tumor assays and not short-term cell lines. Yet the NCI applied this technology to cell lines and Shaw then concluded that these assays don't work, rather than more appropriately concluding that passaged cell lines don't work (e.g. see Kruczynski,A. and Kiss, R. Evidence of a direct relationship between the increase in the in vitro passage number of human non-small-lung cancer primocultures and their chemosensitivity. Anticancer Res. 13:507-14,'93; Smit, et al. In vitro response of human small-cell lung-cancer cell lines to chemotherapeutic drugs: no correlation with clinical data. Int. J Cancer 51:72-78,'92.).

The purpose of the NCI study never was to determine if fresh tumor assays worked. All of the considerable literature which supports the use of these assays in patient management has been based on true fresh tumor (non-passaged) cell assays. The NCI used cell lines because the major expertise of the investigators who carried out the study was in the creation of lung cancer cell lines, and they wanted to see if they could perform assays on these cell lines to use in patient therapy. The results were that they were able to test successfully only 22% of specimens received, including only 7% of primary lung lesions! This contrasts with a 75% overall success rate reported by earlier investigators who used the same assay system in fresh tumors (the Wilbur study quoted in the current review) and a routinely obtained > 95% success rate using improved methods available today.

By any definition, the NCI studied a sub-population of patients (22% of all patients and only 7% of patients with tumor obtained from the lung). What else is known of this sub-population of patients?

It turns out that these authors had previously shown that patients whose tumor cells give rise to immortalized cell lines have a very poor prognosis, relative to patients whose tumor cells do not give rise to immortalized lines (Ann Intern Med 113:764, 1990). Fully 62% of the patients treated with assay-directed chemotherapy in the NCI study had tumors which gave rise to immortalized cell lines, compared to 24% of all patients and 12% of patients in whom assay results could not be obtained (the control group). Additionally, 35% of specimens from metastatic sites could be tested, compared to only 7% from primary lung tumors. The authors themselves noted that "the same factors associated with metastatic potential could enhance in vitro cell survival."

Thus, the subset of patients actually receiving assay-directed therapy were largely members of a group of patients previously identified as having a particularly poor prognosis, relative to a larger group of patients, in a disease where even the most favorable group itself is known to be associated with a very poor prognosis. In a disease such as NSCLC, where the benefits of chemotherapy are well-known to be marginal at best, one might reasonably expect the patients most likely to derive benefit would be those patients with the most favorable prognosis and not the patients with the least favorable prognosis. And yet the patients who received assay-directed therapy were those patients with the least favorable prognosis and these patients were compared to the much larger group of patients who had a significantly more favorable prognosis! What is needed in all studies, obviously, is a control group that consists of patients who have assays successfully performed, but whom do not receive assay-directed therapy. But such a control group is lacking in all studies published to date.

Additionally, all of the work in the past 15 years in the field of total cell assays in epithelial tumors has been carried out largely on three dimensional clusters of cells. I cited the testing of cells in the absence of cell-cell communication as a serious flaw in a letter published in the NEJM in 1983 (Weisenthal, LM. Human tumor stem cell assay. New Eng J Med 308:1478-79, 1983). In my laboratory, we throw away the single cells and attempt to work exclusively with three dimensional, floating, tumor spheroids. What was used in the NCI study of NSCLC? Monolayer cell cultures (source: personal communication with Adi Gazdar). Why is this important? In some of the most important work in this field published in the last 10 years, Teicher at Harvard and Kerbel from MD Anderson independently showed that you can create drug resistant tumor cells in mice by repeatedly treating the mice with chemotherapy and then harvesting the surviving cells from the mice, transplanting them into new mice, retreating the new mice, and so on. After a while, you get cells which are many-fold resistant to the chemotherapy, when tested in mice, but absolutely no more resistant, when tested in monolayer assays in vitro. But if you test the same cells as three-dimensional spheroids, they are now many-fold resistant in vitro, just as they are in vivo. (The authors call this "multicellular resistance," and it may be due to any number of things. For example, cells can pass glutathione back and forth to each other (analogous to bacterial conjugation)).

The fact that the NCI studies in small cell lung cancer were more "positive" than those in NSCLC may well be related to the fact that small cell lung cancer cells, in most cases, do not grow as monolayers but rather do not attach to the surface of the culture plates - instead growing as floating, three-dimensional spheroids (the way that all fresh tumors are cultured for testing in my laboratory). In contrast, non-small lung cancer cells grow as monolayers and the studies of Teicher and Kerbel show the biological irrelevance of monolayer cultures to tumor cell resistance to anticancer drugs.

Also very important is the fact that the NCI authors themselves note that patients who have tissue easily available for biopsy for testing represent a population with more advanced disease and a less favorable prognosis than patients who do not have such superficial tumor tissue available.

Finally, the clinical impact of assay-directed therapy in the (generally positive) small cell lung cancer studies (JNCI 82:117,'90; Clin Cancer Res 3:741,'97) was certainly attenuated by the fact that the assay-directed therapy was not given until after 12 weeks and 4 complete cycles of empiric chemotherapy.

In short, there are absolutely no findings or conclusions in the NCI non-small cell lung cancer study which are in any way germane to the vast contemporary literature which strongly supports the clinical use of these assays, when they are performed by expert laboratories. Yet, within the academic community, it is not uncommon to hear, as I have heard repeatedly, things like "well, they tried that at the NCI and it didn't work. If they couldn't get it to work at the Mecca of Meccas, what makes you think that you can get it to work?"

And that's the problem with these NCI studies. Good investigators. Good institution. Good journals. But vaguely-described methods, misleading analysis, and misleading presentation of data. And it mainly serves to reinforce the opinion held by many in academic oncology that cell culture drug resistance testing has been adequately studied, but has been found wanting to the extent that further studies are of vanishingly low priority and that clinical application is not to be supported.

The true state of the field of CCDRT is that there is a compelling body of data to support its use, but that the question of whether or not the use of CCDRT in clinical chemotherapy improves the outcome of patient treatment has never been addressed in any type of an adequate study - using the CCDRT technologies which are currently being applied to the non-investigational management of 15,000 cancer patient per year in the United States.

But, once again, the standard always applied previously to support the use of medical tests was the acceptable accuracy of the test and clinical utility, in the judgement of the physician ordering the test, supported by clinical logic and common sense. This was also the standard applied by the FDA in its consideration of a kit for cell culture drug resistance testing (for which FDA approval was received and for which clinical and literature documentation of accuracy was inferior to that existing to document the technologies reviewed in Part I of this document and applied by my laboratory as a non-investigational service to patients and cancer treatment specialists).