[prev in list] [next in list] [prev in thread] [next in thread]
List: log4net-dev
Subject: AW: Remoting appender sending deathly slow - was RE: Remote appender not sending
From: "Dominik Psenner" <dpsenner () gmail ! com>
Date: 2013-10-21 14:24:54
Message-ID: 004701cece69$501deef0$f059ccd0$ () gmail ! com
[Download RAW message or body]
This is a multipart message in MIME format.
Glad you were able to sort it out.
Cheers
Von: Howe, Peter L [mailto:phowe@paychex.com]
Gesendet: Montag, 21. Oktober 2013 15:54
An: Log4NET Dev
Betreff: RE: Remoting appender sending deathly slow - was RE: Remote
appender not sending
That was indeed the problem, thank you! I guess I did not fully understand
how the evaluator worked. I changed it to
<evaluator type="log4net.Core.LevelEvaluator">
<threshold value="ERROR" />
</evaluator>
And now things are rolling right along. Thanks Again!
Peter
From: Dominik Psenner [mailto:dpsenner@gmail.com]
Sent: Monday, October 21, 2013 9:33 AM
To: 'Log4NET Dev'
Subject: AW: Remoting appender sending deathly slow - was RE: Remote
appender not sending
Hey!
You have an evaluator set which triggers a flush with every log event that
is >=DEBUG. Maybe that's the reason?
The purpose of the evaluator is to early trigger flushes (bypass the
buffering) when exceptional log events happen. Now, given you are logging
only debug messages the evaluator would hit on every log event and thus
flush your events one by one. That of course comes shipped with a terrible
performance impact.
Cheers
Von: Howe, Peter L [mailto:phowe@paychex.com]
Gesendet: Montag, 21. Oktober 2013 15:17
An: Log4NET Dev
Betreff: Remoting appender sending deathly slow - was RE: Remote appender
not sending
It probably takes 10 seconds for the client program to log all 1,000 events
(just some test code.) The flush is every 10 seconds. I changed my buffer
size to 50 and the flush period to 30 seconds - same behavior. The call on
the server to public void LogEvents(LoggingEvent[] events)- the one required
method on the IRemoteLoggingSink interface, is still never called with more
than one event at a time, and takes a painfully long time to process all of
the 1,000 events logged/sent by the test client app.
Peter
From: Dominik Psenner [mailto:dpsenner@gmail.com]
Sent: Friday, October 18, 2013 5:49 PM
To: Log4NET Dev
Subject: Re: Remote appender not sending
Maybe cause you're flushing too often? As for the last message you did it
with every event, didnt you?
2013/10/18 Howe, Peter L <phowe@paychex.com <mailto:phowe@paychex.com> >
Now that I have it "working" (sort of), I am noticing some very
non-performant conditions.
When I run the client and server process, and leave everything running long
enough, I get all the events to the server, however I see dozens of remoting
connections in NETSTAT, and the server process never sees a batch of events
larger than one. This is the relevant parts of my .config on the client
side:
<appender name="RemotingAppender"
type="Paychex.IP.Common.Logging.TimedRemotingAppender" >
<sink value="tcp://localhost:8085/IPRemotingLogger" />
<bufferSize value="20" />
<flushPeriod>10</flushPeriod>
<lossy value="false" />
<onlyFixPartialEventData value="true" />
<evaluator type="log4net.Core.LevelEvaluator">
<threshold value="DEBUG" />
</evaluator>
</appender>
<root>
<priority value="ALL"/>
<appender-ref ref="RemotingAppender" />
</root>
The client calls logging 1,000 times. The main program (client) thread is
done almost immediately, but if I DON'T leave the client running long enough
(which is a number of minutes) for the pool threads to send all the events,
I get this at program close:
log4net: Hierarchy: Shutdown called on Hierarchy
[log4net-default-repository]
log4net:ERROR [TimedRemotingAppender] RemotingAppender
[RemotingAppender] failed
to send all queued events before close, in OnClose.
I don't understand why the events are being sent to the server one at a
time, instead of 20 (my buffer size.)
Thanks,
The information contained in this message may be privileged, confidential
and protected from disclosure. If the reader of this message is not the
intended recipient, or an employee or agent responsible for delivering this
message to the intended recipient, you are hereby notified that any
dissemination, distribution or copying of this communication is strictly
prohibited. If you have received this communication in error, please notify
your representative immediately and delete this message from your computer.
Thank you.
[Attachment #3 (text/html)]
<html xmlns:v="urn:schemas-microsoft-com:vml" \
xmlns:o="urn:schemas-microsoft-com:office:office" \
xmlns:w="urn:schemas-microsoft-com:office:word" \
xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" \
xmlns="http://www.w3.org/TR/REC-html40"><head><META HTTP-EQUIV="Content-Type" \
CONTENT="text/html; charset=us-ascii"><meta name=Generator content="Microsoft Word 15 \
(filtered medium)"><style><!-- /* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:"Segoe UI";
panose-1:2 11 5 2 4 2 4 2 2 3;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p
{mso-style-priority:99;
mso-margin-top-alt:auto;
margin-right:0cm;
mso-margin-bottom-alt:auto;
margin-left:0cm;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Sprechblasentext Zchn";
margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
span.SprechblasentextZchn
{mso-style-name:"Sprechblasentext Zchn";
mso-style-priority:99;
mso-style-link:Sprechblasentext;
font-family:"Segoe UI","sans-serif";}
p.BalloonText, li.BalloonText, div.BalloonText
{mso-style-name:"Balloon Text";
mso-style-link:"Balloon Text Char";
margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
span.BalloonTextChar
{mso-style-name:"Balloon Text Char";
mso-style-priority:99;
mso-style-link:"Balloon Text";
font-family:"Tahoma","sans-serif";}
span.E-MailFormatvorlage22
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.E-MailFormatvorlage23
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.E-MailFormatvorlage24
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.E-MailFormatvorlage25
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=DE link=blue vlink=purple><div \
class=WordSection1><p class=MsoNormal><span lang=EN-GB \
style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D;mso-fareast-language:EN-US'>Glad \
you were able to sort it out.<o:p></o:p></span></p><p class=MsoNormal><span \
lang=EN-GB style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D;mso-fareast-language:EN-US'><o:p> </o:p></span></p><p \
class=MsoNormal><span lang=EN-GB \
style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D;mso-fareast-language:EN-US'>Cheers<o:p></o:p></span></p><p \
class=MsoNormal><span lang=EN-GB \
style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D;mso-fareast-language:EN-US'><o:p> </o:p></span></p><div \
style='border:none;border-left:solid blue 1.5pt;padding:0cm 0cm 0cm 4.0pt'><div><div \
style='border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm'><p \
class=MsoNormal><b><span \
style='font-size:11.0pt;font-family:"Calibri","sans-serif"'>Von:</span></b><span \
style='font-size:11.0pt;font-family:"Calibri","sans-serif"'> Howe, Peter L \
[mailto:phowe@paychex.com] <br><b>Gesendet:</b> Montag, 21. Oktober 2013 \
15:54<br><b>An:</b> Log4NET Dev<br><b>Betreff:</b> RE: Remoting appender sending \
deathly slow - was RE: Remote appender not \
sending<o:p></o:p></span></p></div></div><p class=MsoNormal><o:p> </o:p></p><p \
class=MsoNormal><span lang=EN-US \
style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>That was \
indeed the problem, thank you! I guess I did not fully understand how the \
evaluator worked. I changed it to <o:p></o:p></span></p><p class=MsoNormal \
style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;text-autospace:none'><span \
lang=EN-US style='font-size:9.5pt;font-family:Consolas;color:blue;background:white'> \
<</span><span lang=EN-US \
style='font-size:9.5pt;font-family:Consolas;color:#A31515;background:white'>evaluator</span><span \
lang=EN-US style='font-size:9.5pt;font-family:Consolas;color:blue;background:white'> \
</span><span lang=EN-US \
style='font-size:9.5pt;font-family:Consolas;color:red;background:white'>type</span><span \
lang=EN-US style='font-size:9.5pt;font-family:Consolas;color:blue;background:white'>=</span><span \
lang=EN-US style='font-size:9.5pt;font-family:Consolas;background:white'>"<span \
style='color:blue'>log4net.Core.LevelEvaluator</span>"<span \
style='color:blue'>></span></span><span lang=EN-US><o:p></o:p></span></p><p \
class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;text-autospace:none'><span \
lang=EN-US style='font-size:9.5pt;font-family:Consolas;color:blue;background:white'> \
<</span><span lang=EN-US \
style='font-size:9.5pt;font-family:Consolas;color:#A31515;background:white'>threshold</span><span \
lang=EN-US style='font-size:9.5pt;font-family:Consolas;color:blue;background:white'> \
</span><span lang=EN-US \
style='font-size:9.5pt;font-family:Consolas;color:red;background:white'>value</span><span \
lang=EN-US style='font-size:9.5pt;font-family:Consolas;color:blue;background:white'>=</span><span \
lang=EN-US style='font-size:9.5pt;font-family:Consolas;background:white'>"<span \
style='color:blue'>ERROR</span>"<span style='color:blue'> \
/></span></span><span lang=EN-US><o:p></o:p></span></p><p class=MsoNormal \
style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;text-autospace:none'><span \
lang=EN-US style='font-size:9.5pt;font-family:Consolas;color:blue;background:white'> \
</</span><span lang=EN-US \
style='font-size:9.5pt;font-family:Consolas;color:#A31515;background:white'>evaluator</span><span \
lang=EN-US style='font-size:9.5pt;font-family:Consolas;color:blue;background:white'>></span><span \
lang=EN-US><o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US \
style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>And now \
things are rolling right along. Thanks Again!<o:p></o:p></span></p><p \
class=MsoNormal><span lang=EN-US \
style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p \
class=MsoNormal><span lang=EN-US \
style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Peter<o:p></o:p></span></p><p \
class=MsoNormal><span lang=EN-US \
style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><div><div \
style='border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0cm 0cm 0cm'><p \
class=MsoNormal><b><span lang=EN-US \
style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'>From:</span></b><span \
lang=EN-US style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'> Dominik \
Psenner [<a href="mailto:dpsenner@gmail.com">mailto:dpsenner@gmail.com</a>] \
<br><b>Sent:</b> Monday, October 21, 2013 9:33 AM<br><b>To:</b> 'Log4NET \
Dev'<br><b>Subject:</b> AW: Remoting appender sending deathly slow - was RE: Remote \
appender not sending<o:p></o:p></span></p></div></div><p class=MsoNormal><span \
lang=EN-US><o:p> </o:p></span></p><p class=MsoNormal><span lang=EN-GB \
style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Hey!<o:p></o:p></span></p><p \
class=MsoNormal><span lang=EN-GB \
style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p \
class=MsoNormal><span lang=EN-GB \
style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>You have an \
evaluator set which triggers a flush with every log event that is >=DEBUG. Maybe \
that’s the reason?<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-GB \
style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p \
class=MsoNormal><span lang=EN-GB \
style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>The purpose \
of the evaluator is to early trigger flushes (bypass the buffering) when exceptional \
log events happen. Now, given you are logging only debug messages the evaluator would \
hit on every log event and thus flush your events one by one. That of course comes \
shipped with a terrible performance impact.<o:p></o:p></span></p><p \
class=MsoNormal><span lang=EN-GB \
style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p \
class=MsoNormal><span lang=EN-GB \
style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Cheers<o:p></o:p></span></p><p \
class=MsoNormal><span lang=EN-GB \
style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><div \
style='border:none;border-left:solid blue 1.5pt;padding:0cm 0cm 0cm 4.0pt'><div><div \
style='border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm'><p \
class=MsoNormal><b><span lang=EN-GB \
style='font-size:11.0pt;font-family:"Calibri","sans-serif"'>Von:</span></b><span \
lang=EN-GB style='font-size:11.0pt;font-family:"Calibri","sans-serif"'> Howe, Peter L \
[<a href="mailto:phowe@paychex.com">mailto:phowe@paychex.com</a>] \
<br><b>Gesendet:</b> Montag, 21. Oktober 2013 15:17<br><b>An:</b> Log</span><span \
style='font-size:11.0pt;font-family:"Calibri","sans-serif"'>4NET \
Dev<br><b>Betreff:</b> Remoting appender sending deathly slow - was RE: Remote \
appender not sending<o:p></o:p></span></p></div></div><p \
class=MsoNormal><o:p> </o:p></p><p class=MsoNormal><span lang=EN-US \
style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>It probably \
takes 10 seconds for the client program to log all 1,000 events (just some test \
code.) The flush is every 10 seconds. I changed my buffer size to 50 and \
the flush period to 30 seconds – same behavior. The call on the server to \
</span><span lang=EN-US \
style='font-size:9.5pt;font-family:Consolas;color:blue;background:white;mso-highlight:white'>public</span><span \
lang=EN-US style='font-size:9.5pt;font-family:Consolas;color:black;background:white;mso-highlight:white'> \
</span><span lang=EN-US \
style='font-size:9.5pt;font-family:Consolas;color:blue;background:white;mso-highlight:white'>void</span><span \
lang=EN-US style='font-size:9.5pt;font-family:Consolas;color:black;background:white;mso-highlight:white'> \
LogEvents(</span><span lang=EN-US \
style='font-size:9.5pt;font-family:Consolas;color:#2B91AF;background:white;mso-highlight:white'>LoggingEvent</span><span \
lang=EN-US style='font-size:9.5pt;font-family:Consolas;color:black;background:white;mso-highlight:white'>[] \
events)</span><span lang=EN-US \
style='font-size:9.5pt;font-family:Consolas;color:black'>- </span><span lang=EN-US \
style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>the one \
required method on the IRemoteLoggingSink interface, is still never called with more \
than one event at a time, and takes a painfully long time to process all of the 1,000 \
events logged/sent by the test client app.<o:p></o:p></span></p><p \
class=MsoNormal><span lang=EN-US \
style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p \
class=MsoNormal><span lang=EN-US \
style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Peter<o:p></o:p></span></p><p \
class=MsoNormal><span lang=EN-US \
style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p \
class=MsoNormal><span lang=EN-US \
style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p \
class=MsoNormal><b><span lang=EN-US \
style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'>From:</span></b><span \
lang=EN-US style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'> Dominik \
Psenner [<a href="mailto:dpsenner@gmail.com">mailto:dpsenner@gmail.com</a>] \
<br><b>Sent:</b> Friday, October 18, 2013 5:49 PM<br><b>To:</b> Log4NET \
Dev<br><b>Subject:</b> Re: Remote appender not sending<o:p></o:p></span></p><p \
class=MsoNormal><span lang=EN-US><o:p> </o:p></span></p><div><p \
class=MsoNormal><span lang=EN-US>Maybe cause you're flushing too often? As for the \
last message you did it with every event, didnt \
you?<o:p></o:p></span></p></div><div><p class=MsoNormal \
style='margin-bottom:12.0pt'><span lang=EN-US><o:p> </o:p></span></p><div><p \
class=MsoNormal><span lang=EN-US>2013/10/18 Howe, Peter L <<a \
href="mailto:phowe@paychex.com" \
target="_blank">phowe@paychex.com</a>><o:p></o:p></span></p><div><div><p \
class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span \
lang=EN-US style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Now \
that I have it “working” (sort of), I am noticing some very \
non-performant conditions…</span><span lang=EN-US><o:p></o:p></span></p><p \
class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span \
lang=EN-US style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'> </span><span \
lang=EN-US><o:p></o:p></span></p><p class=MsoNormal \
style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US \
style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>When I run \
the client and server process, and leave everything running long enough, I get all \
the events to the server, however I see dozens of remoting connections in NETSTAT, \
and the server process never sees a batch of events larger than one. This is \
the relevant parts of my .config on the client side:</span><span \
lang=EN-US><o:p></o:p></span></p><p class=MsoNormal \
style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US \
style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'> </span><span \
lang=EN-US><o:p></o:p></span></p><p class=MsoNormal \
style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;text-autospace:none'><span \
lang=EN-US style='font-size:9.5pt;font-family:Consolas;color:blue;background:white'> \
<</span><span lang=EN-US \
style='font-size:9.5pt;font-family:Consolas;color:#A31515;background:white'>appender</span><span \
lang=EN-US style='font-size:9.5pt;font-family:Consolas;color:blue;background:white'> \
</span><span lang=EN-US \
style='font-size:9.5pt;font-family:Consolas;color:red;background:white'>name</span><span \
lang=EN-US style='font-size:9.5pt;font-family:Consolas;color:blue;background:white'>=</span><span \
lang=EN-US style='font-size:9.5pt;font-family:Consolas;background:white'>"<span \
style='color:blue'>RemotingAppender</span>"</span><span \
lang=EN-US><o:p></o:p></span></p><p class=MsoNormal \
style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;text-autospace:none'><span \
lang=EN-US style='font-size:9.5pt;font-family:Consolas;color:blue;background:white'> \
</span><span lang=EN-US \
style='font-size:9.5pt;font-family:Consolas;color:red;background:white'>type</span><span \
lang=EN-US style='font-size:9.5pt;font-family:Consolas;color:blue;background:white'>=</span><span \
lang=EN-US style='font-size:9.5pt;font-family:Consolas;background:white'>"<span \
style='color:blue'>Paychex.IP.Common.Logging.TimedRemotingAppender</span>"<span \
style='color:blue'> ></span></span><span lang=EN-US><o:p></o:p></span></p><p \
class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;text-autospace:none'><span \
lang=EN-US style='font-size:9.5pt;font-family:Consolas;color:blue;background:white'> \
<</span><span lang=EN-US \
style='font-size:9.5pt;font-family:Consolas;color:#A31515;background:white'>sink</span><span \
lang=EN-US style='font-size:9.5pt;font-family:Consolas;color:blue;background:white'> \
</span><span lang=EN-US \
style='font-size:9.5pt;font-family:Consolas;color:red;background:white'>value</span><span \
lang=EN-US style='font-size:9.5pt;font-family:Consolas;color:blue;background:white'>=</span><span \
lang=EN-US style='font-size:9.5pt;font-family:Consolas;background:white'>"<span \
style='color:blue'>tcp://localhost:8085/IPRemotingLogger</span>"<span \
style='color:blue'> /></span></span><span lang=EN-US><o:p></o:p></span></p><p \
class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;text-autospace:none'><span \
lang=EN-US style='font-size:9.5pt;font-family:Consolas;color:blue;background:white'> \
<</span><span lang=EN-US \
style='font-size:9.5pt;font-family:Consolas;color:#A31515;background:white'>bufferSize</span><span \
lang=EN-US style='font-size:9.5pt;font-family:Consolas;color:blue;background:white'> \
</span><span lang=EN-US \
style='font-size:9.5pt;font-family:Consolas;color:red;background:white'>value</span><span \
lang=EN-US style='font-size:9.5pt;font-family:Consolas;color:blue;background:white'>=</span><span \
lang=EN-US style='font-size:9.5pt;font-family:Consolas;background:white'>"<span \
style='color:blue'>20</span>"<span style='color:blue'> /></span></span><span \
lang=EN-US><o:p></o:p></span></p><p class=MsoNormal \
style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;text-autospace:none'><span \
lang=EN-US style='font-size:9.5pt;font-family:Consolas;color:blue;background:white'> \
<</span><span lang=EN-US \
style='font-size:9.5pt;font-family:Consolas;color:#A31515;background:white'>flushPeriod</span><span \
lang=EN-US style='font-size:9.5pt;font-family:Consolas;color:blue;background:white'>></span><span \
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic