Experiments for structural prediction

[nilsreiter]

Conduct experiments with the following settings:

• Regular
• All lowercased
• Distinguish only paratext and speech

[nilsreiter]

Results 5359a81

P       R       F1      #gold   #system #correct                    
0.760   0.713   0.736   85244   79982   60775   OVERALL             
1.000   1.000   1.000   111     111     111     ActHeading          
0.957   0.995   0.976   632     657     629     SceneHeading        
0.989   0.995   0.992   23453   23586   23330   Speaker             
0.638   0.569   0.602   52173   46491   29676   Speech              
0.769   0.792   0.780   8875    9137    7029    StageDirection

[nilsreiter]

Results 550cb9e

P       R       F1      #gold   #system    #correct
0.748   0.744   0.746   85244   84888      63457   OVERALL
0.814   0.829   0.821   111     113        92      ActHeading
0.912   0.997   0.952   632     691        630     SceneHeading
0.988   0.994   0.991   23453   23597      23322   Speaker
0.632   0.618   0.625   52173   51048      32261   Speech
0.758   0.806   0.781   8875    9439       7152    StageDirection

[nilsreiter]

Results of 32afe72:

P       R       F1      #gold   #system #correct                                            
0.760   0.717   0.738   85244   80437   61111   OVERALL                                     
0.982   0.973   0.977   111     110     108     ActHeading                                  
0.950   0.956   0.953   632     636     604     SceneHeading                                
0.989   0.993   0.991   23453   23543   23289   Speaker                                     
0.636   0.583   0.608   52173   47794   30404   Speech                                      
0.803   0.756   0.778   8875    8354    6706    StageDirection    

[nilsreiter]

Results of 8f7f82a:

P       R       F1      #gold   #system #correct   
0.664   0.613   0.637   85244   78735   52256   OVERALL                                               
1.000   0.000   0.000   111     0       0       ActHeading                                            
0.872   0.935   0.902   632     678     591     SceneHeading                                          
0.964   0.987   0.976   23453   24014   23154   Speaker                                               
0.494   0.443   0.467   52173   46784   23101   Speech                                                
0.745   0.610   0.671   8875    7259    5410    StageDirection