Difference between revisions of "Team:USTC/Model/Performance evaluation"

(Created page with "<html> <head> <!-- Bootstrap CSS --> <link rel="stylesheet" type="text/css" href="https://2018.igem.org/Team:USTC/BScss?action=raw&ctype=text/css"> <!-- Scroll...")
 
 
(7 intermediate revisions by 4 users not shown)
Line 52: Line 52:
 
         </li>
 
         </li>
 
         <!--Project-->
 
         <!--Project-->
         <li>
+
         <li class="active">
 
           <a href="#modelSubmenu" data-toggle="collapse" aria-expanded="false">MODEL <i class="fa fa-caret-down"></i></a>
 
           <a href="#modelSubmenu" data-toggle="collapse" aria-expanded="false">MODEL <i class="fa fa-caret-down"></i></a>
 
           <ul class="collapse list-unstyled" id="modelSubmenu">
 
           <ul class="collapse list-unstyled" id="modelSubmenu">
Line 64: Line 64:
 
               <a href="https://2018.igem.org/Team:USTC/Model/System_Analysis">System Analysis</a>
 
               <a href="https://2018.igem.org/Team:USTC/Model/System_Analysis">System Analysis</a>
 
             </li>
 
             </li>
             <li>
+
             <li class="active">
               <a href="https://2018.igem.org/Team:USTC/Model/Performance_evaluation">Performance evaluation</a>
+
               <a href="https://2018.igem.org/Team:USTC/Model/Performance_evaluation">Performance Evaluation</a>
 
             </li>
 
             </li>
 
    <li>
 
    <li>
Line 100: Line 100:
 
<!--Achievements-->
 
<!--Achievements-->
 
<li>
 
<li>
           <a href="#">ACHIEVEMENTS</a>
+
           <a href="https://2018.igem.org/Team:USTC/Achievements">ACHIEVEMENTS</a>
 
         </li>
 
         </li>
 
<li>
 
<li>
Line 131: Line 131:
 
             <ul class="nav navbar-nav ml-auto">
 
             <ul class="nav navbar-nav ml-auto">
 
               <li class="nav-item">
 
               <li class="nav-item">
                 <a class="nav-link" href="#section1">Page</a>
+
                 <a class="nav-link" href="#section1">Target</a>
 
               </li>
 
               </li>
 
               <li class="nav-item">
 
               <li class="nav-item">
                 <a class="nav-link" href="#section2">Page</a>
+
                 <a class="nav-link" href="#section2">Threshold</a>
 
               </li>
 
               </li>
 
               <li class="nav-item">
 
               <li class="nav-item">
                 <a class="nav-link" href="#section3">Page</a>
+
                 <a class="nav-link" href="#section3">Time point</a>
 
               </li>
 
               </li>
 
               <li class="nav-item">
 
               <li class="nav-item">
                 <a class="nav-link" href="#section4">Page</a>
+
                 <a class="nav-link" href="#section4">The recycle rate</a>
 +
              </li>
 +
              <li class="nav-item">
 +
                <a class="nav-link" href="#section5">Conclusions</a>
 
               </li>
 
               </li>
 
             </ul>
 
             </ul>
Line 153: Line 156:
  
 
       <div class="container">
 
       <div class="container">
         <div class="alert alert-success" role="alert">
+
         <div class="alert" role="alert">
           <h3 class="alert-heading text-center">Performance evaluation</h4>
+
           <h1 class="alert-heading text-center">Performance Evaluation</h1>
 
         </div>
 
         </div>
 
         <!--P1-->
 
         <!--P1-->
 
         <div class="card mb-3">
 
         <div class="card mb-3">
           <div class="card-body">
+
           <div class="card-body" id="section1">
 
             <h4 class="card-title">Target of evaluation</h4>
 
             <h4 class="card-title">Target of evaluation</h4>
 
             <hr>
 
             <hr>
Line 166: Line 169:
 
         <!--P2-->
 
         <!--P2-->
 
         <div class="card mb-3">
 
         <div class="card mb-3">
           <div class="card-body">
+
           <div class="card-body" id="section2">
 
             <h4 class="card-title">Threshold of sensing system</h4>
 
             <h4 class="card-title">Threshold of sensing system</h4>
 
             <hr>
 
             <hr>
Line 220: Line 223:
 
                 <p class="card-text">Last section, we talk about the threshold of the sensing system which is related to the detection limit of sensing system. This part we want to analyze the response of GFP signal to different nicotine input. The nicotine input is set to be within [1e-4,1] M to cover the interval including no GFP response and strong GFP response. Because the interval we set is small, we define sensitivity according to the logarithmic nicotine concentration as the equation below</p>
 
                 <p class="card-text">Last section, we talk about the threshold of the sensing system which is related to the detection limit of sensing system. This part we want to analyze the response of GFP signal to different nicotine input. The nicotine input is set to be within [1e-4,1] M to cover the interval including no GFP response and strong GFP response. Because the interval we set is small, we define sensitivity according to the logarithmic nicotine concentration as the equation below</p>
 
                 <div class="card border-light">
 
                 <div class="card border-light">
                   <img class="card-img-top mx-auto w-75" src="https://static.igem.org/mediawiki/2018/0/0f/T--USTC--Model3-Equation3.png" alt="">
+
                   <img class="card-img-top mx-auto w-75" src="https://static.igem.org/mediawiki/2018/5/54/T--USTC--Model3-Equation4.png" alt="">
 
                   <div class="card-body">
 
                   <div class="card-body">
 
                     <h4 class="card-title text-center">Equation 3 Sensitivity of GFP signal to nicotine input</h4>
 
                     <h4 class="card-title text-center">Equation 3 Sensitivity of GFP signal to nicotine input</h4>
Line 247: Line 250:
 
         <!--P3-->
 
         <!--P3-->
 
         <div class="card mb-3">
 
         <div class="card mb-3">
           <div class="card-body">
+
           <div class="card-body" id="section3">
 
             <h4 class="card-title">Time point of signal processing</h4>
 
             <h4 class="card-title">Time point of signal processing</h4>
 
             <hr>
 
             <hr>
Line 300: Line 303:
 
         <!--P4-->
 
         <!--P4-->
 
         <div class="card mb-3">
 
         <div class="card mb-3">
           <div class="card-body">
+
           <div class="card-body" id="section4">
 
             <h4 class="card-title">The recycle rate of nicotine</h4>
 
             <h4 class="card-title">The recycle rate of nicotine</h4>
 
             <hr>
 
             <hr>
 
             <p class="card-text">The final goal of our system is to transform nicotine from tobacco waste to 3-Succinoyl-Pyridine which is a valuable intermediate for chemical synthesis of medicine. Because some portion of nicotine is catalyzed to 6-Hydroxynicotine to operate the sensing system, not all nicotine is transformed to 3-Succinoyl-Pyridine. We need to evaluate the extent of end product production with certain input of nicotine to validate the efficiency of degradation system. To describe the transformation rate, we define a concept called ‘Recycle rate’ calculated as below:</p>
 
             <p class="card-text">The final goal of our system is to transform nicotine from tobacco waste to 3-Succinoyl-Pyridine which is a valuable intermediate for chemical synthesis of medicine. Because some portion of nicotine is catalyzed to 6-Hydroxynicotine to operate the sensing system, not all nicotine is transformed to 3-Succinoyl-Pyridine. We need to evaluate the extent of end product production with certain input of nicotine to validate the efficiency of degradation system. To describe the transformation rate, we define a concept called ‘Recycle rate’ calculated as below:</p>
 
             <div class="card">
 
             <div class="card">
               <img class="card-img-top mx-auto" src="https://static.igem.org/mediawiki/2018/5/54/T--USTC--Model3-Equation4.png" alt="">
+
               <img class="card-img-top mx-auto" src="https://static.igem.org/mediawiki/2018/0/0f/T--USTC--Model3-Equation3.png" alt="">
 
               <div class="card-body">
 
               <div class="card-body">
 
                 <h4 class="card-title text-center">Equation 4 Definition of recycle rate</h4>
 
                 <h4 class="card-title text-center">Equation 4 Definition of recycle rate</h4>
Line 330: Line 333:
 
         <!--P5-->
 
         <!--P5-->
 
         <div class="card">
 
         <div class="card">
           <div class="card-body">
+
           <div class="card-body" id="section5">
 
             <h4 class="card-title">Conclusions</h4>
 
             <h4 class="card-title">Conclusions</h4>
 
             <hr>
 
             <hr>
Line 375: Line 378:
 
         </div>
 
         </div>
 
       </div>
 
       </div>
 +
<img class="mt-3" src="https://static.igem.org/mediawiki/2018/1/19/T--USTC--bottom.png" alt="" style="max-width: 100%;height: auto;">
 
     </div>
 
     </div>
 +
 
   </div>
 
   </div>
  

Latest revision as of 11:52, 13 November 2018

Target of evaluation


In the part of system analysis, we have talked about the influence of promoter strengths and plasmid copy numbers to initial steady states and expression level of gene elements after sensing nicotine. The goal of our project is to detect nicotine and transform nicotine to more valuable chemicals, so it is necessary to evaluate the performance of sensing system like threshold and timeliness. Besides, because part of nicotine is degraded to 6-Hydroxynicotine which is out of the pathway of 3-Succinoyl-Pyridine metabolism, we need to calculate the rate of nicotine transformed to the target product. Parameter sweep provides us appropriate parameter intervals for system design, so effectiveness analysis is based on these parameter settings (s2 = 0.5, s1 = 0.5, plamid1 copy number =10, plasmid2 copy number = 10). We mainly focus on the threshold of sensor, time point suitable for fluorescence measurement, the recycle rate and the relationship between nicotine input, promoter1 strength and these three properties.

Threshold of sensing system


The usage of sensing system is to detect the existence and concentration of nicotine in the medium, so it has its own detection limit. Besides, in consideration of the complexity of the system, its sensitivity to nicotine input may vary a lot with different concentration of nicotine input. The combination of parameters is another important factor in the discussion of threshold and sensitivity because both low nicotine input and low expression of Vppa leads to inadequate 6-Hydroxynicotine to release the hdnoR repression of GFP signal.

Figure 1 GFP with s1, nicotine input

Figure 2 GFP heat-map

The nicotine input we set is within the interval of [1e-5,1] M and the strength of promoter in is within [0,1]. To get the full vision of GFP change along the time span, the simulation runs for 200000 s. From figure 1 and figure 2, we find that the maximal GFP concentration ranges from 0 to about 2000 nM with the increase of nicotine input. However, the strength of promoter 1 has no significant impact on the GFP maximal concentration. The heat-map shows that when nicotine input is lower than 3.5e-5 M, the GFP concentration is relative low and undetectable.

In experiment, we use microplate reader to detect the fluorescence intensity of GFP. So the specificity and threshold are restricted by the detection limit and specificity of the device in fact. To fit the real condition in experiment, we need to convert GFP concentration (nM) to fluorescence intensity (au). According to the work of 2016 William and Mary iGEM team, we can build up the function between GFP concentration and fluorescence intensity like this:

Equation 1 GFP concentration to relative intensity conversion

We define fluorescence intensity more than 100 a.u. as significant result because the data of our interlab shows that the basal fluorescence of medium is about 60 a.u. under the same excitation wavelength light. This requirement determines a detection limit of GFP concentration. The lowest of nicotine concentration to be detected is decided in turn:

Equation 2 GFP concentration detection limit

Figure 3 Relative intensity heat-map

Figure 4 Contour line of relative intensity

To get the value of fluorescence intensity of GFP, we transform the simulation data from GFP concentration (nM) to relative intensity (a.u.). Figure 3 shows the change tendency of GFP fluorescent intensity which is similar to the condition of GFP. To identify the boundary of relative intensity 100 a.u., we draw the contour line of 100 a.u. intensity. From the contour line (Figure 43), we find the when nicotine input is less than 1e-3.6 M, the relative intensity is lower than 100 a.u. and the result is not significant enough according to the criteria mentioned above.

In conclusion, the threshold of our sensing system is above 1e-3.6 M nicotine and the threshold does not strongly shift with the decline of promoter 1 strength.

Sensitivity analysis

Last section, we talk about the threshold of the sensing system which is related to the detection limit of sensing system. This part we want to analyze the response of GFP signal to different nicotine input. The nicotine input is set to be within [1e-4,1] M to cover the interval including no GFP response and strong GFP response. Because the interval we set is small, we define sensitivity according to the logarithmic nicotine concentration as the equation below

Equation 3 Sensitivity of GFP signal to nicotine input

Due to the application of difference without the calculation of limit value, the sensitivity value is not completely same as the real differential coefficient of GFP intensity-nicotine input curve. To increase the accuracy and smooth the sensitivity-nicotine curve, the sampling interval of log10 nicotine is set to 0.001.

Figure 5 GFP concentration vs nicotine

Figure 6 Signal sensitivity vs nicotine

The variation between promoter 1 strength may influence the GFP signal response to nicotine input, so we select three groups for comparison: 0.1 (group1), 0.5 (group2) and 1 (group3). Figure 5 shows the change of GFP maximal concentration with different nicotine input. All three groups have two bursts in the curve, which means that there are two regions with high sensitivity. This phenomenon is also reflected by figure 6. When nicotine input is between 1e-3.8and 1e-3 M, three groups have very strong sensitivity. The left boundary of the interval is the threshold of the sensing system, which is about 1e-3.8 M for group 2/3, and 1e-3.6 M for group 1. But for the second burst, the interval of the three groups vary a lot. The burst interval of the three groups is [1e-3.2, 1e-2] M, [1e-2.7, 1e-1.3] M and [1e-2.3, 1e-1] M separately. This difference of sensitivity distribution means that we can select specific promoter 1 strength to achieve high sensitivity and precision sensing and measurement in the defined nicotine input range. This idea can be developed to a new application in our future work.

Time point of signal processing


In the experiment, we need to choose the appropriate time to measure the GFP signal to determine the existence and concentration of nicotine in the medium. Besides, to collect the maximal quantity of final product, it is important to select the time point when 3-Succinoyl-Pyridine reaches highest concentration. This session we simulate the change of GFP/NicA2/3-Succinoyl-Pyridine and identify the start time of observable GFP signal and the duration time of GFP signal and NicA2 high expression. At last, according to simulation results, we propose the end time of degradation reaction as the reference to experiment design.

GFP is the fluorescent signal which means the existence of an amount of nicotine in the medium, so we first analyze the process of GFP signal production and attenuation. Figure 7 shows that the variation of time for reaching 100 a.u. is small among different groups and the average time is shorter than 5 min. However, the time for signal complete attenuation (under detection limit) varies a lot which increases greatly with more nicotine input. About the time for reaching maximal GFP intensity, it is interesting that more nicotine input and stronger promoter 1 may lead to longer period for GFP signal maximization, because more Vppa expression means more 6-Hydroxynicotine produced initially to release hdnoR repression quickly. Then we calculate the time interval, which is set to be the time for GFP intensity above 95% GFP maximum, for measuring GFP max intensity. The time interval changes a lot among various nicotine input and the maximal timespan is about 700 min.

Figure 7 Heat-map of signal start time

Figure 8 Signal stop time with s1, nicotine

Figure 9 Heat-map of signal max time

Figure 10 Signal max duration with s1, nicotine

The second signal is AHL molecule synthesized by LuxI. The lowest concentration of AHL to activate the transcription of Lux pR is about 0.1 nM, so we calculate the time in which AHL stays in a functional concentration. For nicotine input is lower than 0.1 M, the functional timespan is about 500-1000 min. With higher nicotine input, the state in functional AHL amount can last for over 2500 min.

Figure 11 Functional AHL duration heat-map

Figure 12 Product max time vs s1, nicotine

In the last part, to collect the final product 3-Succinoyl-Pyridine in highest concentration, the time for reaching maximal concentration is calculated. From figure 12, we notice that the range of time is from 0-30 h and the change of time is strongly related to nicotine input but the impact of different promoter 1 strength seems not significant. The possible reason is that the time of GFP signal activation does not vary a lot (0-60min) as described above which means the time for signal induction does not account for a large portion in the total time for nicotine degradation.

The recycle rate of nicotine


The final goal of our system is to transform nicotine from tobacco waste to 3-Succinoyl-Pyridine which is a valuable intermediate for chemical synthesis of medicine. Because some portion of nicotine is catalyzed to 6-Hydroxynicotine to operate the sensing system, not all nicotine is transformed to 3-Succinoyl-Pyridine. We need to evaluate the extent of end product production with certain input of nicotine to validate the efficiency of degradation system. To describe the transformation rate, we define a concept called ‘Recycle rate’ calculated as below:

Equation 4 Definition of recycle rate

In simulation, we define the nicotine input in the interval of [1e-5, 1] M and promoter1 strength s1 in the interval of [0, 1]. To make sure that 3-Succinoyl-Pyridine reaches the maximal concentration, the simulation time is set to 300000s.

Figure 13 Product max with s1, nicotine

Figure 14 Recycle rate vs s1, nicotine

From figure 13, it is transparent that the relation between 1og10 nicotine input and product concentration follows the exponential function. But the amount of final product is not so strong related to promoter1 strength. Only when nicotine input is in high concentration, product amount tends to decline with the increase of s1. It is expectable because stronger promoter1 expresses more Vppa which transformed more nicotine to 6-Hydroxynicotine rather than 3-Succinoyl-Pyridine. About the recycle rate, we notice that when nicotine input is more than 0.01 M, stronger promoter1 leads to the attenuation of recycle rate. The maximal recycle rate is nearly 100% with small s1 which means that our system is efficient in transforming nicotine.

Conclusions


According to the results of simulation, with defined promoter3 strength, promoter3 strength, plasmid 1 copy number, plasmid 2 copy number, the systematic properties mentioned above is significantly affected by the concentration of nicotine input. Only with high amount of nicotine input, the influence of promoter 1 strength is amplified to an observable extent. We can acquire many valuable information about the rough value or interval of these properties, then these data can be used as reference for exact experiment design such as the choice of sampling time or nicotine input amount.

Modeling results for experiment reference


Defined parameters:

Promoter 2 strength--0.5

Plasmid 1 copy number 10

Promoter 3 strength--0.5

Plasmid 2 copy number 10

Variable parameters:

Promoter 1 strength [0,1]:

Nicotine input [1e-4,1] M

Properties Threshold Signal occurrence time Signal vanishing time Maximal signal time Maximal product time
Range >1e-3.7 M 0-5 min 0-2000 min 0-60 min 0-30 h