Team:NUS Singapore-A/Measurement
the key to attaining reproducibility!
Measurements that do not measure up
Researchers all over the world have been consistently populating the field of research with exciting new discoveries. Often, fellow researchers would wish to reproduce previous experimental results before proceeding. This is especially true for characterizations, where the original research provides a basis for comparison for subsequent perturbations to the system.
However, the difficulty in reproducing comparable experimental data as described in literature is a prominent issue. Many factors can potentially contribute to the discrepancies observed, of which the inherent difference between the instruments used is one of the most probable.
According to Dr. Yeoh Jing Wui, an expert in computational modelling, models constructed using parametric values (e.g. enzyme kinetics, protein degradation rates) obtained from one particular instrument are usually non-transferrable to another set of data collected using a different instrument. A reliable interpretation of two sets of experimental results thus requires the consideration of variation between instruments, but it is tedious to obtain the necessary data experimentally.
Our measured approach: Synchronized fluorescence measurement
Our team aimed to ensure that the parts we submitted can be easily utilized by others. On top of providing characterization data, we also want to evaluate the repeatability of our experimental design and reproducibility of our results by introducing a practical approach as described below.
In this particular experimental design, we were performing characterizations on the EL222 blue light repressible system (BBa_K2819103) to serve as part improvement. The measurements include the following parameters: cell density at 600 nm (OD600), as well as fluorescence intensity of RFP with an excitation and emission maxima of 535 and 600 nm. To mimic experimental trials whereby researchers aim to replicate results from previous literature, we perform synchronised characterization experiments in separate laboratories, where readings were taken using different microplate readers. Cell cultures and necessary reagents were provided independently, and a detailed protocol was followed to the letter in both labs.
The protocol
The following plasmids were transformed individually into E. coli TOP10:
Brep-RFP (blue light repressible system with RFP as reporter protein),
Brep-RFP-YbaQ (with YbaQ degradation tag), and
Brep-RFP-DAS (with DAS degradation tag).
Each of them has the same backbone and carries the kanamycin resistance gene (K).
- Inoculate Brep-RFP, Brep-RFP-YbaQ, Brep-RFP-DAS in 5mL of LB broth (Lysogeny broth) containing 50ng/mL of kanamycin (LB+K) in 50ml Falcon tubes.
- Incubate at 37°C, 225 rpm overnight.
- Transfer 200 µl of overnight culture into fresh 5 mL of LB+K.
- Incubate at 37°C, 225 rpm for 1 hour.
- Measure cell density at OD600 using Nanodrop™ (Thermo Scientific™).
- Transfer 1ml of cell culture final OD600 = 0.1, diluted using LB+K, into a 12-well plate. LB+K is added as the blank.
- Repeat step 6 for triplicates.
- Measure OD600 and fluorescence intensity (535/600 nm) in a microplate reader (Synergy H1, BioTek©) using the following settings:
Temperature: Set-point 37°C
Plate In
Shake: Orbital for 10s
Read: (A) 600
Read: (F) 535,600Excitation: 535
Emission: 600
Gain: 75
Read height: 6 mm
Plate Out - Cover the 12-well plate with a dark cloth.
- Incubate at 37°C, 120 rpm.
- Repeat steps 8-10 every 1 hour over a period of 8 hours.
After the experiments, we eagerly plotted the data (Figure 1).
Despite having expected this, we could not help but feel disappointed at the results. As can be seen, the absolute values obtained from the two labs differed by a substantial margin. This had significant implications: the results were not reproducible, thus no meaningful interpretation of these two sets of data could be established. This also meant that subsequent modeling efforts could only take into considerations data acquired from one of the microplate readers, and other iGEMmers or researchers from all over the world looking to reproduce our characterization results and models would inevitably be let down.
Not all is lost, however. A quick glance at the graphs told us that the trend is largely preserved. We hypothesized that the discrepancies in the absolute values obtained was likely due to the inherent difference in the instruments, i.e. the microplate readers, used. To further evaluate this, we plotted data points obtained from Lab A against that from Lab B, complete with trendlines with equations and R2 values (Figure 2).
A good linear relationship was established between the two data sets with an R2 value of 0.9603. Making use of the linear equation derived, we calibrated data points obtained in Lab A and replotted them against those from Lab B (Figure 3). Indeed, the graphs now almost overlapped each other!
The immeasurable significance of good measurement
Why did we go through all these trouble?
In this measurement practice, we have demonstrated the inherent difference in instruments. The two microplate readers (Synergy H1 Hybrid Multi-Mode Reader) were manufactured by BioTek© in different years, which further proved that differences between instruments are inevitable, even when they are from the same supplier.
Our approach of evaluating the relationship between the experimental datas has allowed the subsequent calibration of raw datas. Hence, a reliable comparison could be established, where the calibrated values of one reader matched the original values of its counterpart. Reproducibility can thus be attained.
For us, this meant that we do not have to rely on a single microplate reader to obtain all our experimental data! Values obtained from the other reader can now be easily calibrated and subsequently used to fit our models.
For synthetic biologists all over the world, our approach suggested that there is a practice which can be followed such that reproducibility is more realizable. In fact, we propose that a routine of synchronized experiments and calibration of instruments be followed prior to data collection. This allows data to be compared across instruments, laboratories, and research.
What we achieved in our "IntraLab" study is hardly groundbreaking, but it is our hope that this simple procedure can eventually become the standard practice for measurements, with iGEM as the springboard.
HEAR OUR STORY
We’re using synthetic biology to change the way the world thinks and functions.
We’re a little disruptive, dangerous and maybe a tad too bold. But the world needs some shaking up every now and then, and we think we’re just the right people for that.
Together we’re going to engineer biology and create something awesome.
CONTACT US
nusigem@gmail.com21 Lower Kent Ridge Rd, Singapore 119077