minor doc fixes

minor doc improvements

propagate JVM_VERSION to sub-makefiles

javadoc fixes

better diagnostics, allow Regsub to return its Regexp object

Defer starting the groovy intepreter until the first time it's needed

simple groovy example

Added <groovy>...</groovy> for Rinaldo.

updated to match MultipartSetTemplate

Implemented new mechanism for automatically saving uploaded files
to disk:
savePattern=[glob pattern] is used to specify which files on the form
   are automaticaly written to disk.
saveName=[file name with ${..}]
   is used to define the name used to save the file; field values
   can be used as part of the name
This is safer than the previous strategy, as it prevents malicious users
from creating arbitrary files.

make inner class static

When using <foreach ... list="stuff" delim=[regexp] sort=no>
then the matched delimiter and all of its sub-matches are made 
available in the scope of the foreach.

Added name=xxx attribute to save source'd content to a property instead of
always incorporating it inline

better handling of invalid class errors for handlers

script to fix the version strings in all the source files

fixed @version strings

sync samples/simple
- format updates

sync everything (except samples)
- unified version handling for java versions in Makefiles
- direct file uploads and saves for MultiPartSetTemplate
- add "keep" flag for RestartHandler
- minor doc fixes

add RestartHandler to Makefile, after checking java version

Allow a server to restart when it gets a sigHUP.
This causes all the handlers to be reinitialized.
The restarted configuration can be supplied either by an external
configuration file, or the existing server.props can be reused.

Credentials file can be re-read, allowing for the dynamic addition
of credentials.

Allow null patterns in Glob.match() [always returns false]

Initialze token type to STRING so getAttributes doesn't crash
if called before nextToken

minor update (and test of the putback email distribution [1])

use url.orig instead of request.url for uri checking

request.url is modified by various handlers to change the current notion
of what the current url is.  However, sometimes (as in redirects or
authentication), the original url is required.  For historical reasons,
"request.props("url.orig")" is the original URL, and request.url is the
current "virtual" url.
 
This changes has "url.orig" set when the request is first created, so
handlers/templates that change request.url don't have to check for it
first. Oh well.

update documentation to better reflect reality

- better diagnostics (log level=5 displays xactionwith smtp server)
- better documentation
- proper handling of <param> and </sendmail> tag debugging

Add AsteriskTemplate, a simple interface to the Asterisk (pbx) management interface
doc fixes

UrlMapperHandler.java: Make sure "export" ends with '.' (bug fix)
BSLTemplate.java: doc updates

- VirtualHostHandler.java sets "url.orig" property
- TemplateHandler.java nos sets "fileName" not "FileName"

added "restart" method to enable server restarts with new configuration.

don't emit inline post data into output stream

"enum" became a reserved word, change to "enumer".

doc updates

<list max=nnn front=true> will trim items from the front of
the list instead of the end ("front" is new)

- bug fix: timeout=0 was waiting forever (now it waits for 1 ms)
- changed System.out.print... messages to log()

- Macros in the "init" file can use ${..} substitutions from server.props
  in their definitions
- The ScriptEvalTemplate now handles both <script> and <style>, and
  allows for optional "\X" substitutions

doc fixes (we can build the pdf docs again)

doc fixes.  Fix to config.vote so the calculator now works

- remove files in scripts/exclude.txt from generated documentation
- doc fixes so the xml checker doesn't barf

- added map= attribute to M<extract>
- remove spurious diagostics from MacroTemplate

- added "exclude.txt" to exclude listed files from a distribution.
- Some scripts contain references to absolute file paths, that were
  pointing to non-existant files.

Updated docs to explain how to use the calculator with <if> ... </if>

- The initial macros file is now interpreted as an xml template, and not
  a java properties format file [WARNING: backward un-compatibility]
- main() may be used to convert the old style macro initialization tables
  (which no one used 'cause they were too hadr to generate) into the new
  format.

add diagnostics so we can track remote fetches at level 4

doc fixes for previous putback

in "location" headers, all reasonable url's are properly converted
into absolute url's

-doc formatting fixes
-install path fixes
-date updates

doc fixes

added attributes to facilitate sending query data

doc fixes

add methods to allow handler/templates to access queues directly

Change quoting rules (again) to always add quotes.  This is
more XMLish bahavior

Added additional handler/template

doc format fixes

Added methods to allow for better error diagnostics (e.g. line #'s)

\s maps to [space] and \v maps to ' (\q was already taken)

added "na" and "zeroindex" attributes for specifying n/a values, and
either 0 or 1 based indexing for the table results

Changed the default implementation of SessionManager from a
hashtable of hashtables to a concatenated key, using the CacheManager
key generation algorithm

Version of the IncludeTemplate that automatically handles
re-directs and ssl (but requires jdk1.4+)

documentation formating fixes

Bug fix:  namespaces imported inside of <foreach> loops were being
lost after the </foreach>.

A "smart properties" handler that allows pluggable mappings
of property dereferences.  For example, if ${foo} exists, then
${cnvt(foo)} will filter ${foo} through the "cnvt" filter to
obtain the value.  Multiple filters may be installed, and the
format of the filter syntax is configurable.

Added DigestAuthHandler.java that supports digest authentication
in (modern) versions of IE and mozilla.

> Forgot to remove once-only check; it doesn't make sense now
> that we have an "directory" attribute.  Added a "select=[!]<glob>"
> attribute fo file selection
> 
<

Fixed how the "directory" attribute is resolved:
- if it starts with "/", relative to the doc root
- otherwise, relative to the current directory

Added better error checking to XmlTree
included sample "bsl checker" script

Added template to convert remote host to a hostname (reverse DNS)
[needed for new experimentalstuff-dlc integration
]

added template to manipulate xml DOM's
fixes to StunnelHandler

added more templates

New template to "source" documents into an existing template
<source src=xxxx eval=true|false [encoding=xxx]>

Made this one more useful (The multiHostHandler is too complicated)

- bug fix: setting a max size never increases the size
- backward test when reading back sessions from PropertiesCacheManager

- fixed limit=nnn so it works
- fixed off-by-one error in "rows" property
- added rowCount property
- added errorCode property

bug fix for NPE when an extract is not found

- fixed bug in list handler:  max=n was broken
- added "DelayHandler" to intoduce latency into request handling

update files for generating documentation for release 2.1

changed to reflext removal of BasePRoperties

change PUT to POST in form demo (for mozilla 1.4)
add dynamic beanshell tag to beanshell example

add our modified version of "tcl.jar" to the tests to make
them possible to run outside of Sun

documentation fixes to remove javadoc warnings.
- add "protocol" option to StunnelHandler
- fix typo in SslHandler

* update package documentation for javadocs
* create script to auromatically extract external references
  in package descriptions.  This will be integrated into the Makefile
  someday to auto-generate the readme files in the distribution

Document updates for all files, plus:
DirectoryTemplate:
  added directory=xxx attribute
Makefile
  PageTemplate removed (superceded by ListTemplate)
SSLHandler
  Add fingerprint to cert properties

Move return out of finally clause to eliminate warning about finally clause not able
to return normally.

Fix up export to handle non-versioned PropertiesList.  Also add a build.xml file
to build with ant if desired.

Make sure compiler is at least 1.2, but generate code for 1.1 VMs
Stop the build if a 1.1 compiler is used.  Change default tools to use
1.3.  Along the way, redid the versioning macro and the tests, as well
as add some output comments.

Remove need for versioned PropertiesList files.  Now there is only
one file.  Note, since it contains Java 2 API, it can only be
compiled with Java 2 compilers, but it can run on Java 1 VMs
if compiled with the "-target 1.1" option.

Delete versioned PropertiesList.java files

Stupid edditing error on last putback

The servlet prefix is now stripped off the url at the beggining, and
added back for all text/html content (whose length is now recomputed
properly)

Changed the way the servlet finds its config file and document root, by
viewing the "web.xml" file as a replacement for ...server.Main [args] and
modelling it the same way.
 
Always use the servlet context root to resolve "cwd()" as the directory
of the script that started the web container is almost never useful

change the quoting rules in quote() to err on the side of adding
quotes.

- Bug fix:  classes we all defining their own, inconsistant notions of
  what "true" and "false" meant.  They've all been consolidated into
  a single location: Format.isTrue()/Format.isFalse().
- Template.java checks for a debug flag using the template runner's prefix
  if "debug" is not found in the template's prefix.  This is now consistent
  with the behaviour of "tagPrefix"

- fixed "tagPrefix" property so all Brazil tags may be prefixed properly.  This
  allows easy disambiguation of server/client evaluation for UCML examples.  Templates
  should no longer explicitly look for their closing tag.  Instead they should use
  RewriteContext.isClosingFor(), and RewriteContext.addClosingTag()
- no changes (or lint) made to: DateTemplate.java, HttpRequest.java, DirectoryHandler.java,
  ExprProps.java, 
- Minor bug fixes to: StunnelHandler.java

The server socket was not initialized.  It is now set to the server's
listen socket.

rewrite to new semantics
(I'm not sure why this wasn't put back a long time ago)

cosmetic changes

- added StunnelHandler to allow Brazil to use stunnel as an ssl gateway, 
  by "fixing" the protocol field of all redirects from sll gateways.  This
  uses the "serverProtocol" variable that was just added to Request.java
- added PlainTemplate to allow html pages to contain HTML to be displayed as
  HTML, without having to escape each special character.

added a "serverProtocol" variable to allow handlers to change the
protocol (e.g. http) the server claims to be using on a per-request basis.
If "serverProtocol" is unchanged (the default), then the Server.protocol
is used instead.
 
This is useful when fronting Brazil servers with ssl gateways; the protocol
can be changed from "http" to "https" to allow redirects to work
properly

Add protected modifier to variable connected so subclasses outside
of package can access it.

New implementation uses a hashtable (in addition to a Vector) for
long lists to make isMember() checks fast

Bug fixes for Joe/Rinaldo:
ExecTemplate:
 process.exec(command) does not allow white space in arguments.  There
 is a new "usesh" flag that (on unix) will exec: /bin/sh -c "command"
 as a workaround
FormTemplate
 the "size" attribute of input tags gets processed through format.subst now
SetTemplate
 <namespace remove> is added.  It has the original semantices of
 <namespace clear>, that is the namespace is completely removed, instead
 of just having its elements cleared.  This allows namespaces to be
 generated dynamically (without bound) without overflowing memory

Sync with workspace.
- this should be the current "Joe Ferrill" demo
- redo group operation; groups now owned by admins (more like chat rooms)
- redo group and bot variables to deal with scalability issues (e.g. don't import userd namespace)
- use new "Q" closed flag for more efficient Q management
 
About to redo user and group management to use the "ListTemplate".  Hopefully this will
increase the scalability by ~10x.
 
Hopefully the new bot stuff (from leo) didn't break in the process - I didn't test it.

added the PageTemplate capability to the ListTemplate
PageTemplate is now obsolete

Move PageTemplate and ListTemplate into "sunlabs" package from "slim" so
they appear in the docs.  Neither are SLIM specific.

The PropertiesCacheManager now exports a "Saveable" interface to allow
 session objects other than "Properties" to have their state saved and 
 restored in a portable ASCII format.

The PropertiesCacheManager now exports a "Saveable" interface to allow
session objects other than "Properties" to have their state saved and 
restored in a portable ascii format

Minor cosmetic changes to BasePropertiesList

first pass at a list "smart properties" to permit list manipulations
in html templates

changed the semantics of getProperty() and getNames() to treat all wrapped dictionaries
as if they are properties objects, using get() and keys() instead of getProperty() and getNames() if the
wrapped object isn't a properties

Added "PageTemplate".  This allows easy paging through long lists
of items, in anticipation of chat scaling issues

Add the ability to create new template tags on-the-fly using beanshell

bug fix: empty Html bodies were causing null pointer exceptions

Use only one versioning mechanism to decide which dirs to include.

New macro template with examples.  This one should work a lot better

Must do "setGid" before "setUid", or the "setGid" will fail.
doh!

Remove diagnostic output

fixed previous putback (sorry)

move check for redundant poll into the right place

don't try to clear a non-existant namespace

Adds further support for dynamic creation and deletion of bots, also allows login and logout of existing bots.

- <namespace clear> now "clears" the table, but does not un-link it
- better attribute checking in corner cases

Putback the basic stuff I have for getting bot create and delete to work, still have to work out the bugs with the new bots not actually having any data scripting files to work with, its a bit tricky.

Add jdk1.1 conditional include for "ssl"

Build slim only if using a 1.4 compiler

Add shared props after Request.props rather than before server.props

Updated the version numbers of all files to 2.1

- refresh user list as needed
- stop playing when a tone is recvd
- play message for incorrect password
- don't play incoming messages while recording
- remove "after nnn" attempts to fix a bug introduced by closing
  the wrong files
- fix up messages a bit

Integrated changes from SunNetworkDemo version
- added log level, altavista enable from "admin" console
- use environemt variables to set servers and proxies
- added additional documentation
- cleaned up debugging messages

- added "testing" client for load testing
- merged in sun one demo changes

fixed google, add "sun1 network site search

bottom.html: send "message.replace" and not "message" to TTS
fetchBrowser.html: lost <script>...</script> around focus() call
top.html: add "admin" link

forgot to add to workspace (sau)

adminbot was not part of the sccs files for some unknown reason

Not much - merely a change in about

Added testing release notes that indicate:
-tests work on 1.1 and 1.2
-tests break on 1.3
-tests mostly work on 1.4

Misc:
- doc changes to Request.java, Readme, todo
- test fixes for jdk 1.4

add "outputEncoding" parameter to specify the String -> byte[] conversions
This allows for the handling of non-western character sets.

telephone client for SLIM

Fixed some stuff with voicing and SLIM.
Added the tcl client in the client-tcl subdirectory.

Added the ReXXShell template to the contrib directory.  Also added a (very) simple
example to the samples/simple directory of how to use the rexxshell template.

Changed TTSServerHandler to a more sensical configuation schema.  Changed the config file to match this new schema.  Added Javadocs to TTSServerHandler.  Fixed the PCM16 audio issues with TSServerHandler.  Fixed the wave header issues in TTSServerHandler.

process ${...} constructs in the URL on a per-request basis

Added the ability to scale the mulaw sound level dynamically

Minor changes, PCM works again with .au, still uncertain with .wav
PCM8 no longer a encoding option, sampling is specified in the config file at
server start for the TTSServerHandler, configure multiple such for different
sampling rates (this fits with the FreeTTS multiple diphone database structure)

Added the HOWTO file.
Attempt to Fix the Wav transmission - doesn't work.  Wav and Au in ML8 work fine, but
nothing but garbage for PCM8 and PCM16.  Tried byte swapping and whatnot - no use.

- remove "*" imports
- fix typos
- rename ..Handle to ..Handler
- add "mustHave" option to TTSServerHandler

fixed (i hope) ws to reflect the AliceHandle to AliceHandler name change

Some minor bug changes.  AliceHandler from AliceHandle.  Javadocs added

All tests are now working (with Solaris_JDK_1.2.2_07a)

another attempt at getting the tutorial to end up in the correct location

entirely doc fixes, except
slim google script works again (for now)

- try to make the tutorial build in the right place
- add the beginnings of a "class roadmap"

lots of little documentation fixes

Added WAV and RAW file support for the Brazil based TTS Server.  Also fixed a minor change in bottom.html (SLIM package) to properly remove state regarding the existence of a new message.  <br/> was made into <br /> in the aiml files.

Polling failed when using certain combinations of "match", "format", and
"interval"

remove bogus addheader directive

calls to HttpRequest were sending bogus (or no) "Host:" header.
if no "host" header is found, derive one from the URL
- Added utilities for extracting portions of URL's to HttpUtil

files missing from distribution:
 - alice std aiml files
 - chatw.html
MenuTemplate was using String.replaceAll() a 1.4 feature, breaking
  compatibility with jdk1.1 gatuitously
Makefile dependancy ordering was incorrect
run script is missing

New Features: 
   Beanshell Support for new Admin Pages
   Audio Tasks in Admin
   Chat Groups
   Fixed MenuTemplate
   Fixed Audio Transmission Support
   Added ability to edit bot predicates in the admin pages.. more to come

Add "javascript" to the list of dependencies

check for missing content-type header

Remove bogus destination for tutorial.html

velocity external class links for javadoc

template for creating the (unfinished) tutorial

README installed in srcs directory of release

sun public license terms

Fixed up some errors in the documentation.

Added javascript package to the makfile
Created a "stub" describing the javascript package (needs to be filled out still).

add an "about" link

Add JavaScript via Rhino to template capability.  Have fun!
JavaScript is cool.  Especially with the LiveConnect feature.

First pass entry of SLIM (Sun Labs Instant Messenger).  Basic Functionality.

Request object reference wasn't being reset on each request

"eval" only does ${...} substitutions, but leaves \X's alone

Make the "eval" attribute do ${...} substitutions, but leave all\X's alone

add encoding diagnostics to displayAllHeaders

- Added getEncoding() and getContent() methods to HttpRequest to
  deal with HTTP charset encodings
- Changed PollHandler.fillProps() sig. to pass HttpRequest object instead of
  an inputstream, so enable access to the new convenience methods
- Changed RePollHandler and IncludeTemplate to use the getContent() convenience
  method in HttpRequest, for unified charset encoding treatment
- fixed TclRePollHandler to use new fillProps() sig.

- fixed misleading diagnostic message in ChainHandler
- Don't override content type in sendHeaders() if it is already set.

Add "RunAs" handler.  This supercedes the "ChownHandler".
The RunAs handler contains native code for invoking setuid() and setgid().
the native code library the "ChownHandler" uses stopped working
(and I don't have the sources)

Added "encoding" option to be applied when converting bytes into
Strings.  This is the 1st pass attempt to handle other than default
language encodings; its incomplete

- Better diagnostics when Template class is bogus
- QueueTemplate handles multiple recipients
- SessionFilter does set-cookie header paths properly

Added a rule "reindent" to reindent the export sources using Jindent

-Make QueueItem public, so other classes can interact with the Queues
-Add "meta" data field to the queue item, in anticipation of multi-language
 support

The "ChownHandler" doesn't work on Solaris9.  Create a
"RunAsHandler" as a replacement, that includes the sources for the
nativve code.  It should be fairly straight forward to make this
work on most flavors of Unix

bug fix: wasn't calling super.init() properly

- SimpleSessionHAndler extract= does ${..} substitutions by looking
  in http headers first, and then in request props
- removed bogus poll interval startup messages

Added sample "screen scraping" demo that uses google to do language
translation

- add inverse match to SimpleSessionHandler.  This makes it easier
  to detect robots (e.g. NOT IE|Mozilla|Opera...)
- add "status" pseudo header to "getheaders" (IncludeTemplate) to
  make it easier to do error recovery
- fixed a typo in the ChownHandler (GrooupName - groupName)

- added "addheaders" attribute to permit the additon of http headers
  to the target request
- added "getheaders" attribute to permit the extraction and return
  of all htt response headers
This premits a (clumbsy) mechanism of negotiating session or login
state with a server (such as dealing with redirects and cookie
requests) using only BSL.

Added "post" attribute to IncludeTemplate, to make it easier
to use for the IM language translation services

Added "defer" option to PropertiesCacheManager.java that allows the
loading of saved sessions as needed instead of at server startup

A new bsh.Interp was beeing created for each new session weather it
was being used or not.  Only create one if actually used.
Update bsh example to demo per-session persistence

More files that got left out, sorry

These files got lost somehow

- deleted more unused files
- added "contrib" to list of "other" files included in the release
- minor doc updates

- deleted more unused files
- added "contrib" to list of "other" files included in the release
- minor doc updates

more workspace cleanup
All "deleted" files are now in the .deleted_files directory

more workspace cleanup

workspace cleanup

documentation fixes.
1st pass at the new "tutorial"

Added Makefile in docs to generate pdf documentation
Added "make release" target in Main makefile to build a release
added minor doc corrections

left out of previous putback

The makefile in "docs" almost builds all the documentation automagically now

more script consolodation in preparation for integrating the pfd
file generation into the workspace

More Makefile cleanup.  This include Makefiles to make it easier to
  distribute the tests and samples
removed more "dead" subprojects
created better diagnostic messages

This is a continuation of previous change.  Neglected to update these
make files in that change.  All fixed now.

Put Makefile.common under workspace and SCCS.  Fix all Makefiles to point
to it.  Force use of Gnumake.

- add "tests" to DEPENDS
- running the tests in tests/Makefile is now a separate step (from
  building the test java files), and doesn't depend on jacl being installed:
  (it uses tcl.jar directly)

Minor fixes so Brazil can still be compiled under Java 1.1

first pass at workspace cleanup.  "delete" lots of old cruft

trim() script sent to transformer; it doesn't handle extra whitespace well

Rinaldo's version of LDAPTemplate.
Its here (and not replacing the original one) because it needs
more documentation and cleanup.

added "history.tcl" to extract the CodeManager history as a web page

Started a "contrib" directory"
- started it off with Rinaldos "applyxslt" template
- Still needs work

Fixed sorting to look for numeric option when using the "glob" or "match" options.
Added "sample" config to test various sorting options

Fix <foreach glob=> to use the propertyNames(glob) of propertiesList

The "unique" values generated as session tokens aren't unique enough.
(I've had reports of different user's getting assigned to the same
session).
 
Solution:
- create a "GUID" generator everyone can use, and make the default
  implementation more unique than before
- Provide a mechanism to install new GUID generators at deployment time
- change all GUID generators to use the common implementation

Enhance documentation for VelocityFilter.  Add capability for read
only access to public fields of Server and Request by the Velocity
template.

- doc changes
- typo fixes (the template example works again, with saveing state)

Added optional configuration to demonstrate how to use the Properties
CacheManager and the PollHandler to periodically save all session
state to disk

Added new sample that demonstrates:
- how to build a "poll" site that allows users to vote
- how to build an entire site out of a single web page

Added more extensive documentation.  Manage the BeanShell interpreter
by session.  Look for the script in the filesystem first, then the
classpath.  Pass the script through Format.subst before handing it to
the interpreter.

Update/fix documentation.  Hopefully remove EmailTemplate.test for good.

Tested auto-cd detection (it works); updated docs

Choose Runtime.exec method at run time.

fix SCCS version strings

Add SCCS keywords back in

The ADDJARS macro got lost

The version of ExprPropsHandler I copied from
~drach/brazil/ws/handlers a few minutes ago (this one compiles)

Revert to old, stable ExprPropsHandler

Changed private methods to protected.

Move ExprProps from properties to handler, but leave in properties package.

added "public static boolean displayAllHeaders"
to enable http header debugging during development.
 
This can be enable from a script, as in:
<tcl>java::files sunlabs.brazil.util.http.HttpRequest displayAllHeaders true </tcl>

The build should be fixed again.  Several Makefiles changed to cause
properties to be built after util and before server.  This broke
the server "minimum" build.  Add a target to strip unnecessary files
out.  Added "versioned" PropertiesList classes.

Move some files around.  Also pass request.props to ExprProps rather
than request in ExprPropsHandler.

I was at an arc review today, when I heard that the "resource
monitoring" capability of an (unnamed) web server-like product was going
to be pushed-back to the next release, because there wasn't enough time
to figure out how to do it.
 
Out of curiosity, I wanted to see if I could implement this functionallity
in Brazil in less time than it took to discuss it.
 
So, here it is.

-documentation fixes
-remove CountTemplate

Replacefilter: looks for "Template" in resource if not found in file system
SMTPHandler: when used as a template, doesn't verify server connection on each page

directory rename

The "missing" extra html docs that go with the javadocs
Feel free to update them

TODO list of noever completed (or started) projects for Brazil

TemplateFilter.java: defaults to "text/" (was "text/html")
RestrictClientHandler.java: changed log reporting level WARNING -> LOG
TemplateHandler.java: Checks for mime type starting with "text/"

lost the "public" in front of "public void tag_digest" ..

auxilliary html files now get added to javadoc output
The following files are now used to generate the javadoc output
- all the javadoc comments in the sources
- overview.html
- html/*.html (extra html file)
- packages/*.html (package documentation files)

Stuff to generate the api docs

This stuff is obsolete.
after "rescuing" the helper scripts, this directory is going away.
The new version will be in the "docs" subdirectory, which will contain
both the procedure for building the javadocs as well as all additional documentation
that is added to the auto-generated stuff

added package documentation files to the workspace.
The procedure for generating the api docs was never in the workspace;
its about to go there

- sync-up code with existing tests in preparation for "release"
- "removed" buggy Email tests (feel free to fix them guym if you like)

next pass at samples directory update

oops

first pass at updateing the samples directory in preparation 
for the next last? Brazil release

Minor changes to allow building Brazil when not on local NFS network.

Changed location of Velocity jar file

Added the Velocity template engine.  This is a first cut.  There is
no documentation yet.

Removed Main's dependency on BServletServerSocket.java

added a temporary dependency on "servlet" so naws builds

lots of little cleanups:
- EmailTemplate: better failure diagnostics.  Added docs demonstrating
  additional (un-fixed) bugs
- MultiHostHandler - revert to previous behavior; glob matching was buggy
- PollHandler: allow ${...} in url names.  Permit additional target headers, 
  rationalize namespace interaction
- SetTemplate
  added "set" option to <get>: values can be converted and copied between
   namespaces
- QueueTemplate: added timestamps
- Request: added support in sendResponse() for head requests [might not
  be 100% yet]
- Connection: log-level changes: level "3" is more useful now
- SSl: added docs
- DateTemplate: doc fixes
- HttpInputStream: changed the semantics of copyTo() to better report the
  number of bytes read from the stream [this shouldn't break any existing uses]
- DigestTemplate: New [this should be an exprProps]

Remove duplicate code from BrazilServlet and enhance Main.startServer
so BrazilServlet can use it.

Fixed output format as per Rinaldo's suggestions

Bug fix.  When used as a template, <sendmail> was contacting the
server for each page (it doesn't anymore)

Added better diagnostics.  Althought the race condition still exists
that causes sent mail to be lost, this "fix" at least allows the
user to be informed when the system malfunctions

Instant Messager client for Brazil example
- samples/im: The sample application
- QueueTemplate.java: the message Q template (should be in samples/im)
- SimpleSessionHandler.java: enhancements to permit multiple sessions/per user

doc lint

-added "addHeaders" convenience method for adding http headers from
properties objects (HttpRequest.java)
- added "namespace" property to PollHandler, making it distinct from "prepend"
- added "headers" property to pollHandler, allowing the addition of http headers
- rewrote the SimpleSessionHandler (hopefully) making it easier to use in
  applications such as robot or user-agent detection

Log error on mail transmission failures (this is still a mess).

use "url.orig" instead of request.url if available to compute proper
environment variables.

fix version skew wrt Server.java

fixed bug introduced by last Server.java putback (oops)

Added beanshellhandler

Bug fix: Server no longer dies quietly if it can't resolve the local
hostname.

Added "MD5Filter" top add http digest header.
Large file transfers are being corrupted; this allows the
data integrity to be verified by the client.

sendResponse() now does the "right think" for HEAD requests.
(This is required by "smart" download clients that can fetch a
 large document in pieces using byte-range headers).

Fix example so it displays correctly.

Added a hostname based "deny" option.  This provides an easy way
of restricting access to portions of a site from "bad guys" with:
   xxx.deny=\\.(ir|iq|af|cu|ly|kp|sy|sd)$
[sigh!]

REwrote the "allowGt" stuff:
- removed the functionallity from LexML; the behavior is now done
  via overriding findClose()
- Removes allowGt tag from SetTemplate (it doesn't belog there)
- Created AllowGtTemplate to demonstrate how to add new '>' functionality
 
Now "fixing" the "allowGt" behavior should be localized to the AllowGtTemplate

More comment updates for automatic documentation generation

comment fixes for online document updates

Add a simple example to the comments.

merge with beanshell

Made the old behavior of >'s embedded in attributes the default; added
allowGt() [in LexML] to change the behavior on-the-fly.
 
Added <allowgt>...</allowgt> to the SetTemplate to turn on the behavior
in selected regions.  The following whould "work":
 <allowgt>
 <if name="${x > 4}"> ...
 </allowgt>
 <img src="foo.gif> ...

Added BeanShell template processing.

Changed the default behavior of LexML to permit unescaped >'s inside
of quoted strings.
 - <set name=foo value="a > b && c > d">
   works as expected
 - <img src="foo.gif>
   which used to work, now breaks.
Both the new and old behaviors are supported.  I've set the
new behavior as the default (for now)  comments?

Bug fix:
Images were being delivered as text/html.
- replaced old prefix/suffix matching with MatchString
- Fixed directory and suffix checking so the TemplateHandler may
  be used by itself (bit-rot reduction)

- fixed documentation in SetTemplate
- added proxy=host:port option to IncludeTemplate

- doc fixes for pdf file generation
- better docs for UrlMapperHandler

Add date scanning (stolen from jacl) to the DateTemplate.
We need this to generate calendars using BSL for rinaldo

added IAIK copyright notice

added "name=xxx" to include template to direct the result of
an "include" to a property instead of directly inline

Created "ExecFilter" to call an external program to filter content.
This is required for the FIA project demo to on-the-fly convert
images to a smaller size

- added <namespace ... load=xxx> and <namespace ... store=xx> to allow
  namespaces to be read/written from files on the server
- added <date ms=nnn> to format times specified in ms (as well as sec) so
  "timestamps" may be used for date arithmetic.

Rinaldo found a bug - using props prefix instead of url prefix.

- added print button
- changed from "onError" to inline error handling
- consistent with suff on pn17.eng

Minor cleanups

Added options for pulling SessionID out of http headers.
(For the YOPY "thin client" demo)

* added "tag counter" to rewriteContext to aid in debugging
* <folder list...> may be called on an arbitrary directory.
  - make a cursory check for "validity" before returning a folder
  - return folders in a single property to alleviate performance issues
    when querying large directories
  - add "glob=" to gain acceptable performance (the "validity" check on
    each folder can be expensive)
 
* handleFatalError doesn't provide sufficient debugging info for tracking
  down problems
  - added "Exception" argument, to centralize error tracking 
  - Changed "errmsg" on most calls to be more useful
  - moved call to log() into method, to provide better diagnostics
 
* Modified getMessageObjects
  - moved "startmsg" and "msglimit" processing inside, allowing us to add
    new options (such as searching) in only on spot
  - Getting message info for a single message was (sometimes)
    returning an array to lots of message objects, then ignoring all but the
    first.
 
* Not fixed: no check for never-supplied default directory

Hopefully, this is that last set of revisions for "version 1"

Temporary patches:
- handleFatalError now takes an Exception as a parameter, to permit better
  diagnosing of errors
- Several places are checked for "ReadOnlyFolderExceptions" to prevent
  bogus "lost connection to server" errors
- Code added to detect a refile into a bad folder from tossing a bogus
  "lost connection to mail server" error
 
* Many (if not all) of the "lost connection to mail server" messages
  are erroneous, and could be more accurately detected by examining the
  exceptions.

GenericProxyHandler:  Added config option to add target http headers
SetTemplate: added "imports" config option to auto-import namespaces
DeCommentTemplate.java: "really stupid typo broke this

Forgot to check message array for null before fetching messages

Fixed an off-by-one-error in EmailTemplate.java (prevmsgnum) and also fixed an incorrect result in the test suite for 
EmailTemplate.

Rewrote getMessageObjects() - should be clearer, easier to debug, and probably faster.

- Temporary patches to get past message-window bug
- make a "filter" so we can get our SessionID from the SessionFilter
  (this "fixes" the broken attachments)

documentation lint

Another checkpoint.

The EmailTemplate has been updated per code review comments and suggestions.  The Makefile for the test suite had to be modified to include the proper JAR files in classpath for the EmailTemplate.
A new test file for the EmailTemplate was built with basic functionality tests only. It is setup to use the test IMAP server on pn17.eng, which answers on port 144.  The test file is fully configurable via properties at the top of the file.

added extraction property "all" that contains the entire content.

remove debugging left in inadvertantly

remove unneeded imports

"match" was being used both for url prefixes and ip addresses (duh).
changed "match" to "restrict" for ip addresses

Bug fix:
- Keep Template.debug() from emitting nested html comments (which don't work)
- <input value=$...}> should do the right thing this time.

Fixed a bug in the getnewheaders functionality, where the last old msg pointer was getting into an inconsistent state.
For the getnewheaders action, you no longer have to pass a 'startmsg' parameter.  That state is being kept internally in the Java code.

- re-organized colors and preferences
- got separate message window to work again
- escapded <> properly in <set> tags

- bug fix: FormTemplate wasn't processing ${...} properly
- bug fix: Forma wasn't processing \r properly

Fixed implementation of refilemsg so that pending messages to refile are actually refiled before a folder action=purge or the selection of a new folder.

Added support for alternate ports in the <email> tag - the specification for an alternate port is now 'server:port' in the 'server' paramater of the email tag.  If the port is left off, the default IMAP port will be used.  Also fixed a very annoying bug
that was causing the email client to 'lose' subjects mysteriously.

Re-architected the refile msg capability for increased performance and made all performance measurement diagnostics print using the LOG_DIAGNOSTIC type of hr.request.log().

Added more change entries.  "change-log" is still missing
stuff. "make diffs" from .../brazil/naws should provide a "hint"
as to what is still missing

Broke up performance monitoring so that we can see the time it takes to get message objects, prefetch the headers, and populate the return properties.

- Changed <if ... any> to use the PropertiesList glob enumerator.
  (The <foreach glob> should be similarly modified)
- Added <get ... max=nnn> to limit the length of a value.

Server now depends on PropertiesList which depends on Glob, so
glob needs to be added to the "required by server" list.
 
So much for building a "small" server these days.  Oh well..

Snapshot of the Brazil email reader-sender.
All basic functionality is complete:
reading email with mime attachments
sending email with mime attachments
automatic "filtering" of incoming email
uploading/downloding email filters
 
The GUI still needs lots of work:
- dynamic stylesheets to select colors and highlighting
- re-layout of the preferences
- re-layout of the menubar
 
The key performance issue is refiling messages (~2 seconds/message -
a big deal when you have 1000's of email messages).

- add DeCommentTemplate - strips comments out of html files
- add <if name=[glob pattern] any> ... </if> to see if any propery
  exists that matches a glob pattern
- add ReFilter - processes text-like content through a regsub
- add/fix <namespace name=...> ... </namespace> to SetTemplate.
  This makes it easier to delete entire namespaces
- Format.subst now maps \l\g\a to <>& to make it easier to include
  "funny" characters in values
- FormTemplate now processes value=${..} constructs if the "normal"
  behavior would leave the value un-set
- doc changes to FilterHandler
 
I needed this stuff to make the email reader more rational

add "clear" option to import to clear a namespace

Fixed a problem with onError handling when no connHandle was found

First round of changes to support attachments in the email compose functionality.

Add PropertiesList documentation to Request.  Change some methods in
PropertiesList so they correspond to the new documentation in Request. ;-)

Added comments to PropertiesList.  Changed the implementation of a couple
methods.  Changed the signature of one method -- that's why ExprPropsHandler
changed also.

Added additional javadoc documentation for the <sendmail> tag (handling attachments) and also now correctly keep track locally of user authentication state in EmailTemplate.java

space for simple cofig files that work with a single
html file/template to demonstrate the operation of a single handler or template

fixed bug in MultipartSetTemplate.java, added limit on the
max size for form data

added MultipartSetTemplate, a sub-class of the SetTempalte that
processes form/multipart data and places the results into
the request props, optionally base64 encoding binary files

ExprProps was using a cached version of request.props that it acquired
at construction time, so variables stored by <foreach> weren't found.
The solution is to add a new method to Calculator that allows one to
use a symbol table for duration of calculation, and to have ExprProps
give the most recent request.props to Calculator on every calculation.

bug in "template"; was using wrong value for $port

Fine-tuned the exception handling so that if fatal errors are returned from the EmailTemplate, we can guarantee that the user needs to re-authenticate with the email server. 
All other errors are returned in a seperate property.

Brazil example ala experimentalstuff that demonstrates re-writing
all content into user customizable templates

fixes for sessionTable option

Modified the 'getnewheaders' operation of EmailTemplate.java to return a list of the 'newly arrived' messages, as defined by messages after a certain count.  This operation now makes use of the
'startmsg' parameter to determine where to look in the folder for 'newly arrived' messages. It also returns a property, prefix.lastmsgnum, which can be passed repeatedly to 
the 'getnewheaders' operation to detect these messages.  If 'startmsg' is ommitted or
is the empty string (""), the operation will return *all* headers in this folder, potentially an expensive operation.

fixed javadoc comments.  The first sentence of every Class comment
*must* end with a period (.) to aid the automatic extraction of
handler summaries

created "stock" portfolio example using basic authentication
- added "eval" option to <tcl>
- modified BasicAuthHandler to interoperate with <set...>
- added <addHeader status=nnn> to change http result code
- fixed bug in TemplateHandler that was resetting the http status code

The documentation for time formats was wrong.  I fixed thd docs by
allowing an option to specify the format used for matching.

Fixed bug where creating folders in EmailTemplate.java was not working

Fixed compilation bug in EmailTemplate.java by changing the reference to hr.setRewriteState to 
hr.abort()

Change server.props back to Properties object.  This allows server.props
to be shared amongst Threads.  Created Request.serverProps as a
PropertiesList wrapper for server.props.  Each Request will have a
unique serverProps wrapping the shared server.props.
 
Note, you may need to remove all *.class files before rebuilding.

Finished test cases that demonstrate/test bug fixes from code review

Per code review, changed the Abort, Break, and Continue flags to a single stateFlags enum.
Also fixed a bug where incrementing of the nestingLevel was in the wrong place.  Fixed a bug which was not restoring request.props back to its original state during an <abort>, <break>, or <continue>

Stock portfolio example.  Demonstrates:
- RePollHandler
- ExprPropsHandler

Fix NullPointerException in PropertiesList debug code.  Also make the
code provide correct caller when PropertiesList invokes a PropertiesList
constuctor.  That is, we don't want PropertiesList to be listed as
caller -- we want method that initially invoked PropertiesList.
 
Move PropertiesList debug initiation to earliest possible point, before
the first PropertiesList object is created.

minor bug fixes

documentation updates

Add "key" option to RePollHandler to allow one of the sub-matches to be
used as part of a property name instead of a numerical index
 
add ../properties to the depends list in the "test" directory

Added support in EmailTemplate.java for per tag error handling (with the onError parameter).

Made BSLTemplate code thread-safe again after adding support for <abort>, <break>
and <continue> tags.
Also finished documentation for the <abort>, <break>, and <continue> tags.

class names in properties files with trailing whitespace are tough to find, 
so trim() all strings befor Class.forname()ing them.

Remove SharedProps and replace with PropertiesList

Fixed problems in BSLTemplate tests - don't use <set name=x value=foo> *inside* of
test bodies - use the set props {} tcl instead - this prevents namespace collisions
within tests further downstream.

Added support for a <forcetimeout> tag in the EmailTemplate, to be used in testing/debugging
to allow HTML developers to programatically force a timeout/close event at the IMAP server.

allow PollHandler to extract to SessionManager properties, 
acessable via <set namespace=xxx>

Added support for <abort>, <break>, and <continue> in BSL - warning
only <abort> has passed all of the regression tests - use <break> and <continue> at your own
risk until they finish passing the tests.

Completely changed the way properties are extracted.
OLD way:  Create a regular expression that turned the content into
          a java properties file, then "loaded" it
NEW way   Matches and sub-matches are automatically extracted into
          properties based on numerical indeces (or names)
 
To Do (still)
- RePollHandler and <extract> should share the same code
- PollHandler should accept session-table for properties, instead
  of dumping everything into server.props

Even after nextToken() returns false, calls to getBody()...
return reasonable values instead of throwing exceptions

Added SimpleSessionHandler (as a simple example to describe what
session handlers do).

documented behavior of "prefix"; it maps to the PATH specifier on
the set-cookie header.
 
The sessionFilter always uses PATH=/ (which is probably a bug) so it
didn't have the same bug

Fix cookie path by adding a url prefix property.

changed MatchUrl to MatchString

Changed <param...> implementation to use StringMap instead of Hashtable;
header order is now preservered (some smtp servers *require* mime-version
and content-type to be first, RFC822 non withstanding

Changed (undocumented) "allow" property to "getOnly" and reversed the
sense: any method is OK by default, specify "getOnly" to accept only
GET requests

SMTP template <param> tag was broken

Changed all occurrences of "MatchUrl" to "MatchString"

- SsslHandler has an option for asking for a client cert, and can use
  the cert ser# as a session key
- The other sessionHandlers don't ses a session key if it alreay exists,
  allowing cert id's or cookies, or url rewriting in the same server

- Format: fix javadoc warnings
- ssl: provide cert id, and update docs

First pass at the Certificate Authority handler.

The deck got dropped, and the cards were out of order.  They're
now properly resequenced

first pass at an email client

Changed Format.subst to allow modifying \X behavior on a per-call basis.
Modified ScriptEvalTemplate.java to (mostly) leave \'s alone

Makefile now points to proper classpath

doc fixes to remove javadoc warnings

Added ScriptEvalTemplate.  Allows ${...} substitutions in javascript
programs (<script>...</script>) if eval=true is in the "script" attribute.

RewriteContenxt.hr.get() now has Format.subst() built in

- Added MatchUrl as a convenience method for handlers to decide if
  the url should be processded.  Changed most handlers to use it.
 
- Changed most Templates to use new convenience methods in RewriteContext
 
- Added TemplateTemplate to allow template processing of properties from
  within a template.
- Added initial definition file to MacroTemplate
- Moved "PropsTemplate" functionality to SetTemplate as "<get...>"
- Added <tag name=x> => <x  in SetTemplate
- Made sure all the existing tests still work; aded tests for
  "Format" and MatchUrl
- Format.subst() now deals with escapes (\) rationally.
- Moved several classes inside of their only consumers so they are
  not needlessly exposed in the filesystem.

Add comments to both.  Add get method to ExprProps.

Add comments and a main program test driver to Calculator.
 
Fix spelling error in documentation in BrazilServlet.

added the capability to do:
 <sendmail ...>
    <param name=.. value=...> ...
 </sendmail>

Made the 'folder parameter a consistent name (foldername) within the <message> and
<folder> tags - also changed the implementation of the refilemsg, deletemsg, and
undeletemsg functionality - these now send requests to the server in one chunk - 
hopefully improving performance.

use jdk1.1 compatible methods of Vector()

Added a session based macro-processing template.

Creation of properties directory and content, including ExprProps facility.

make fields public so they may be accessed from tcl or python

Added getnewheaders and undeletemsg operations to the <message> tag

Changed SharedProps.addDict() and SharedProps.removeDict() to account for
semantic change to Dictionary.equals() between Java 1 and Java 2.

Added support for a folder parameter in the <message> tag to allow for multiple windows to operate on different folders at the same time.  Also added support for  a new mode in the <message> tag - the ability retrieve only the new headers.

The SMTPHandler will now work as a template:
  <sendmail from= to= body= subject= cc=>

Changed variable substitution algorithm in Format to, hopefully, make
it easier to understand and to allow future additions.
   
Added Calculator class for general purpose arithmetic expression and
statement evaluation.

changed timespamps from "ms" to "sec"

Added fix for the parturl property (attachment handling) so that a proper filename is 
provided for the 
'Save As' dialog - Also added fix for the msglimit 'off-by-one' bug.

getMessages returns additional fields, making it easier to use in
the common cases.

Added support for message ranges in deletemsg,refilemsg.  Fixed msgindex property to accurately reflect message number, put in support for pre-parsing addresses into rcf822 and
personal parts.  Implemented a msgcount in the folder tag to return total messages and new message counts. Put in support for pre-parsing date fields to return a string representation, as well as the number of seconds since the epoch for that date.

<message action=getheaders startmsg="" ...> should do the right thing

Fixed support for multipart/ALTERNATIVE and multipart/DIGEST in message viewing.

Added support for multiple open folder connections, and added a reconnect() routine to EmailTemplate.java to be used in case of FolderClosedExceptions.

Fixed performance problem in header retrieval and added support for querying the entire list of message headers.

added url Prefix options, for consistency (and I needed them)

Added support for 'D' and 'R' msg status flags in EmailTemplate.java

Fixed various email example html files, plus fixed EmailTemplate.java's javadoc source.

Fixed HttpUtil.java to correctly handle 
 within convert=html

added "email" to depends list

fix javadoc warnings

First revision of the EmailTemplate and supporting HTML examples.

1st pass at integrating the old ssl stuff into the new server.
It is quite incomplete, but what's there works OK
 
The Certificate Authority handler and the Server Certificate Generating
code has yet to be integrated in

Move all Brazil Servlet classes into the sunlabs.brazil.servlet package.

edits to build javadocs for java-one snapshot
- moved servlet code from package brazil.net to brazil.servlet
- moved SqlTemplate to brazil.sql
minor stuff for snapshot

Brazil can now run under any web/app server that supports the 2.2 Servlet
API.  This is a bidirectional Brazil Servlet interface.

Reduce access control on selected fields and methods either to make the
class "subclassable" or to expose generally useful methods.

Extra stuff needed to get the experimentalstuff.com site working.
- UrlMapFilter.java rewrites url's from local content for all url's that
  refer to "web mounted" resources (via the multiproxyhandler)
- ExpContentTemplate.java extends the ContentTemplate to further
  filter the "content" property using regular expressions

(1) Count all bytes written out in Request.java
(2) <python> always needs a match </python> but it only was looking
    for match on first time trough the server

- allow <foreach delim=xx> were "xx" is a regular expression
- fixed memory leak in SetTemplate
- removed over enthusiastic diagnostic generation from <property>

SetTemplate was failing to chain namespaces onto the request properties
when they were non-existant when first encountered, but created
during a page.

added "all" attribute to <extract> to permit the extraction into
properties of all matches to a particular regular expression

Added new template "ExecTemplate" to run arbitrary "shell" command

now works with SessionFilter as well as Cookie Handler.  There should be
a better way of "session generators" to let "session consumers" know
the status of the session.

I forgo to add TemplateInterface to the makefile

added stuff

make "debug" protected so it may be used!

added SubstAllTemplate

Last putback of change-log was incomplete.

Added "TemplateInterface", so templates aren't required to subclass Template.
Added convenience method in Template, debug() fo putting diagnostic info
   in the html output as comments
Changed templates to use debug() method. [Now that templates can have their
  own configuration prefixes, "debug" may be turned on/off selectively].

"compareToIgnoreCase" doesn't exist in jdk1.1

Template tokens added.

case-insensitive sorting

Bug fix.  If no namespace was specified, then "" was used instead of the sessionID

Added Template specific tokens, so Templates can be named and have their
own properties in a similar way to handlers and filters.

- Comments updated in TemplateFilter and TemplateHandler to say the following
  about the templates property:

  <code>templates</code>

  A list of template names.  For each name in the list, the property
  <code><i>name</i>.class</code> is examined to determine which class to
  use for each template.  Then <code>name</code> is used as the prefix
  for other template specific properties if any.  If
  <code><i>name</i>.class</code> does not exist, then <code>name</code>
  is assumed to be the class name, and there are no template specific
  properties for the template.  Methods in the template classes will be
  invoked to process the XML/HTML tags present in the content.

- TemplateFilter and TemplateHandler changed to handle the new signatures
  for TemplateRunner.<init> and TemplateRunner.process.

- Added server and prefix args to signature of TemplateRunner constructor.
  Created private instance variables to store server and prefix.  Removed
  server and prefix from TemplateRunner.process signature.  Updated
  comments.

- Added a String field to TemplateRunner.Dispatch to store the template
  specific prefix.

- Changed processing of TemplateRunner's names argument to handle tokens
  as well as class names.

- Changed TemplateRunner.process to set hr.prefix to template specific
  prefix before processing each template.

- Added comment to RewriteContext.prefix indicating that it is assigned
  a new value before processing each template.

- Added sunlabs.brazil.template.TemplateRunner.test.  It demonstrates
  that template tokens didn't work before and now work.

New api's for SessionManagers:
- The underlying methods are now getObj, putObj and removeObj.
- The static method getSession() is rewritten to use getObj and putObj.
- The static methods get(), put() and remove() are exposed for cases
  where getSession is not appropriate.
- Existing uses of getSession() should work without modification

added changes to log

removed getHostname() call from server added at version1.17 for logging).
It does a reverse DNS lookup on every request, causing significant
performance degradation

S. Drach bugs
- Template runner mishandled _xx constructs in method names
- Typo in NoImageTemplate
- Plain filter now uses utility method instead of private one

fixed htmlEncode to match the documentation.  &<>" now encode as entity references instead of #xxx;
 
<python> now has an "eval" option to allow ${..} substitutions.  The ${..} doen't conflict with python syntax, 
and this makes it consistent with <sql>

bug fix in SetTemplate

SnarfTemplate

errant source file reference removed

Don't create empty sessionManager sessions

- merge with colins changes
- added "SnarfTemplate" for Charles so he can control content extraction
  at a finer grain
- changed the time-base back to sec from ms
- minor doc and diagnostic message changes

BSLTemplate.java: When glob or regexp pattern had more than 20 subexpressions,
a limit was being exceeded that should have been detected, but instead was
causing an ArrayOutOfBoundsException due to an off-by-one programming error.
  
BSLTemplate.java: Add server property "${prefix}.limit" to the <while> tag to
prevent excessive recursion.  It's a server property not a request property so
accidental or malicious HTML cannot change the limit.
  
BSLTemplate.java: The <foreach> tag now creates temporary variables in a new
Properties object rather than in the main request.properties.  Seems to be a
cleaner implementation.  It took longer to (A) save any old values, set the
temporary values, and then restore the old values than to (B) push a new
Properties object that lives for the body of the <foreach>.
  
-----
iplanet orgtool:
Has some of its own utility classes (a cache) rather than just using Brazil
core classes, so it must be built and run in its directory where it can find
the utility classes.
  
Cache class used in user interface to show whether a person's reports have
further reports of their own.  Otherwise, it takes about 2 seconds/report to
fill in the reports frame.
  
-----
tests/defs: 
"array {set,get}" was not object aware, so added wrapper.
Other procedures to make writing tests easier: squish, hash.
  
tests/BSLTemplate.test: new tests for <while>, <if>, and <foreach>.

> Added the ability to set and use values from alternate session tables
> with <set namespace=xxx> and <import namespace=xxx>

added convert=html and convert=url options to <property> in the 
PropsTemplate.  Convert=html protects ", <, >, and &.  Convert=url
makes the substituted value safe for url's or query parameters

Latest changes to iPlanet orgtool.
  
BSLTemplate.java: <while> tag added to allow iterating until a property
or other condition is met.
  
SetTemplate.java:
Add "default" option to set template, based on observed usage.  <property>
has "default" option, but this is only useful if the property is going to
be substituted into HTML.  Adding "default" to <set> allows easier use of a
possibly-undefined property whose value is going to be passed to another
tag via ${...}.
  
iplanet/FakeASessionHandler.java: 
Q&D.  Evades chokepoint due to all templates mutexing on a single session
ID (previous implementation) w/o requiring that clients provided a session
ID (cookie).

LDAPTemplate.java:
NullPointerException when storing LDAP information in hash table.
Theory: looking up a non-existent employee returns null.
Practice: it seems a non-null entry can be returned, but all the fields
in the entry will be null.

More tests.
  
defs:
Crash in Template code.  SessionManager state is accessible across Servers
if multiple Servers instantiated in same process.  New Server was getting
old Server's Templates.  Workaround provided for testing purposes, but
not a real solution.

PropsTemplate.java:
<property name=foo default=${bar}> was inserting the literal string "${bar}"
rather than the value of the variable "bar" if the variable "foo" was 
undefined.
   
LexHTML.java:
Use Vector.indexOf() rather than iterating over the elements of a Vector
manually.

README was hopelessly out of date

Currently, if any handler changes request.url, the original url is lost, 
which is unfortunate if you want to refer to the original url.
 
Until I can figure out a better scheme, handlers that change the original url
should set the property "url.orig" if its not already set, so url "consumers"
can access either the current (request.url) or original url's.
 
The "propsTemplate" has been modified to reflect the original url instead of
the current url, which (I hope) is the right behavior most of the time.
 
(This *temporary* change will allow the research.sun.com site to work
 properly when using the HomeDirectoryHandler)

Don't save out empty sessions, prune them instead

re: Tags with special body syntax (like <script> or <style>)
-- Given "<script></script>" (with nothing between the "<script>"
   and the "</script>"), parser was not seeing "</script>" and
   it was grabbing the entire rest of the document as the body of
   the script tag.
-- Singleton "<script src=foo />" will now also work.

Documentation for test suite in defs file.
  
BasicAuthHandler.java - test suite found a bug!

base orgtool, not iplanet version.  Should be moved to a different place.

Extra debuging information if there is a problem running the init script.

added comments to show how to fix "CHDIR" bug when running under jdk1.3

Return "server error" upon cgi failure

New testing style: creating handler objects and calling methods directly 
(instead of creating a server and having it create the handler object) so
I can then access the methods and fields of the handler object directly.

Handle singleton HTML tags like <br/> or <a name=foo/>.  Before, these 
forms were interpreted incorrectly as the "br/" tag or the value "foo/".

added entries for latest putback

- Modified ClockFormat/DateTemplate to accept an optional
  timezone argument
- Changed TclServerTemplate to accept <tcl>...</tcl> and to
  start the interp on first use (instead of at init time)
- Added RePollHandler and TclRePoll handler to experiment with
  modifying remotely retrieved content
- Added a "redirect" capability to RestrictClientHandler
- TemplateHandler checks to insure the url suffix is a valid mime type
- Fixes to documentation generation

ChangedVector.add() to Vector.addElement() for compatibility with java 1.1.

admin/favorites.html
.deleted_files/experimentalstuff/html/admin/highlight.html
.deleted_files/experimentalstuff/html/admin/customize.html
.deleted_files/experimentalstuff/html/admin/main.template
.deleted_files/experimentalstuff/html/admin/missing.html
.deleted_files/experimentalstuff/html/technology
.deleted_files/experimentalstuff/html/technology/index.html
.deleted_files/experimentalstuff/html/index.html
.deleted_files/experimentalstuff/html/init.tcl
.deleted_files/experimentalstuff/html/help.html
.deleted_files/experimentalstuff/html/projects
.deleted_files/experimentalstuff/html/projects/index.html
.deleted_files/experimentalstuff/html/downloads
.deleted_files/experimentalstuff/html/downloads/index.html
.deleted_files/experimentalstuff/html/downloads/bits.tar
.deleted_files/experimentalstuff/html/downloads/download.html
.deleted_files/experimentalstuff/html/images
.deleted_files/experimentalstuff/html/images/palett1.gif
.deleted_files/experimentalstuff/html/images/search.gif
.deleted_files/experimentalstuff/html/images/b.gif
.deleted_files/experimentalstuff/html/images/crayol2.gif
.deleted_files/experimentalstuff/html/images/home07.gif
.deleted_files/experimentalstuff/html/images/exp_stuff1.jpg
.deleted_files/experimentalstuff/html/images/exp_stuff2.jpg
.deleted_files/experimentalstuff/html/images/exp_stuff3.jpg
.deleted_files/experimentalstuff/html/images/exp_stuff4.jpg
.deleted_files/experimentalstuff/html/images/exp_stuff5.jpg
.deleted_files/experimentalstuff/html/images/keybord1.gif
.deleted_files/experimentalstuff/html/images/exp_stuff6.jpg
.deleted_files/experimentalstuff/html/images/rolodex1.gif
.deleted_files/experimentalstuff/html/images/sunlogo.gif
.deleted_files/experimentalstuff/html/images/notepad.gif
.deleted_files/experimentalstuff/html/images/main.css
.deleted_files/experimentalstuff/html/images/logo-small.gif
.deleted_files/experimentalstuff/html/images/writit1.gif
.deleted_files/experimentalstuff/html/testing
.deleted_files/experimentalstuff/html/testing/download.html
.deleted_files/experimentalstuff/html/testing/debug.html
.deleted_files/experimentalstuff/html/testing/test.html
.deleted_files/experimentalstuff/html/testing/index.html
.deleted_files/experimentalstuff/html/testing/headers.html
.deleted_files/experimentalstuff/config.log
.deleted_files/experimentalstuff/config
.deleted_files/alphaworks
.deleted_files/alphaworks/html
.deleted_files/alphaworks/html/config

Test suite:
1. Timeout during request gave error "null 408 Timeout".  Should be
"HTTP/1.1 408 Timeout"
2. "make" in tests directory makes brazil and runs tests suite.

Suggested changes:
Allow search for "A B" to mean employee whose records contain both A and B.
(Previously, no boolean searching, and "A B" meant literal "A" "space" "B".)
  
Don't show AOL or SUN employee numbers in search results.

Put ClockFormat and DateTemplate back into "makefile"
added "timezone" option to ClockFormat
added timezone option to DateTemplate

- tag attribute syntax changed <filelist prefix=nnn stats>
- aded "Stats" attribute to provide last mod and file size info

handle "file:/foo" as a valid URL type in employee record.

Remove RechainableProperties from Request.  In order to insert shared 
Properties objects, use request.addSharedProps() instead of manually 
rechaining the properties using props.setDefaults().

PTServe.java: PickleTalk (in progress).

LDAPTemplate.java: 
explicitly release LDAP connection rather than waiting for GC to
get it, or can run out of file descriptors.
  
samples/orgtool/iplanet/*: iPlanet's orgtool.

fix handling of "root" property:
  HomeDirHandler can specify name of root property
  ReplaceFilter looks in "prefix.root", then "root".

PickleTalk: avoids slush and ready to put on open network.
See README for uploading and IP instructions.

- fixed bug in LexML.java with unterminated comments
- Fixed bug in GenericProxyHandler.java that was causing the thread to hang.

- doc fixes
- make more fields public, for easier scripting

You forgot to checkin the ldap Makefile

Documentation for LDAPTemplate, and moved it to sunlabs.brazil.ldap package.

- BasicAuthHandler.java: make map table public, to allow scipting
- LDAPTemplate.java: remove wildcard imports

<extract> tag for BSL

LDAPTemplate and the samples/ldap directory.

updated change-log

FileHandler now supports simple byte ranges of the form:
   range:bytes=start-end
where either start or end may be missing

- Escape ${...} with $\{...\} in Format.subst()
- add a rudimentary base64 decoder to Base64.java

documentation fixes

- doc fixes to MapPage
- HtmlRewriter.accumulate() now returns previous setting
- ContentTemplate rewrite

Make the MultiProxy url mapping table public, and allow
MapPage to take a (null) prefix.  These minor changes allow
a filter to be written easily that will apply the Proxy url rewriting
on non-proxied content.

added RestrictClientHandler

- New handler to allow conditional access to URL's based on client ip addresses
- Allow ${...} substitutions in replacement strings for the UrlMapperHandler,
  permitting sessionbased rewriting of url's

Added the ability to fetch as url on a cron-like schedule

added PollHandler to periodically fetch java/properties from a remote
web site and stuff them into the server properties

Changed the default behavior of the SetTemplate to use
a persistent namespace.
- "persist" is gone, its now the default
- "local" is used to set a variable for the duration of the request only

fix typos in javadocs.
The java-doc generators now create:
   /handler_options.html
which is an alphabetized summary of all handler options.

All handler properties are now described in the class
javadoc comments with syntax of the form:
   <dl class=props>   ....... </dl>
to allow automatic extraction of properties options

- added exitOnError flag to TemplateFilter
- doc fixes

Sample config file to demonstrate how the LogHandler works

- added LogHandler to generate custom log files
  + added accessor methods to Request for logging
  + changed Format.subst to take Dictionary instead of PRoperties
  + changed bytesWritten to per request instead of per connection
- lint

added stuff

Added -S flag to Main.java to permit ${..} substitutions on property values

bug fixes to ContentTemplate and MapPage
new color processing for exp stuff

- added client ip address to PropsTemplate
- Changed log-level for filter init failures

rename alphaworks to experimentalstuff

- changed SessionFilter to handle htmlified plain text files
- fixed up alphaworks

- AddHeader template works with "location headers", allowing in-page
  redirects
- TemplateRunner generates better diagnostics
- next "pass" at alphaworks site sample

Documnetation fixes only
see http://hack.eng:8082/ for the lastest version

Added "ModifiedTemplate" to allow template re-writing to keep track
of last-modified times of documents better.

remove spurious debug printf's

- new template to allow printf like debugging of html templates
- better support for mime header manipulation from html templates

Fixed typo (duh!)

performance enhancement.  Allow all processing to be skipped
if no highlighting is required

- Highlight template supports finer control over highlightable regions
- SetTemplate now works in conjuction with the SetTemplate installed
  as a handler, mostly obsoleting the functionallity of the ConfigFileHandler, 
  especiall when used with one of the persistent session thinkies
- PropertiesCacheManager, a new handler/sessionManager, provides 
  rudimentary persistence for session state stored in java Properties

- first pass at alphaworks website setup
- start-of-request timestamps added
- replace filter gets "debug flag": it rereades the template each request
- filterHandler gets better diagnostics
- SessionFilter re-do
- SetTemplate is also a handler - persistent properties may be shared

Added primitive URL mapping.

added <layer src=...> to the list of html entries that are urls

- lots of little doc fixes
- make more templates serializable
- added SerializableCacheManager.java, which combines CacheManager and
  SerialPersist.  The integration of Persistence and Session managers
  needs to be re-thought

Added better redirect behavior; its now invisible to browser users.
If the user accepts the cookie, the normal stuff happens.  If not, the
sessionId gets tacked onto the url instead

> Added SessionFilter, which is a combination of the CookieSessionHandler
> and UrlSessionFilter.  It tries to use browser cookies to manage
> sessions (like the CookieSessionHandler), but if cookies don't work,
> it encodes and extract the session id's from the urls
>
> see config-session for a simple config file to test this out

added "save" option to serialPersist

made more templates serializable so they work with the serial-persist
session manager

Fixed bug in TemplateHandler that caused it not to find the session ids, 
preventing each session from getting its own template instance.
 
Added SetTemplate, that supports <set name=xxx value=yyy [persist]>
to allow templates to set properties, possibly persisting across sessions.
For general purpose programming, a scripting language should be used.
This is for common simple cases.

There was a race condition in TemplateRunner.  After calling process()
and before calling getContent(), another thread could blow away the
content.
 
Removed getContent(), and make process() return the content (or null)

bug fixes

- Added "exitOnError" property that causes the server to exit if any
  handlers fail to initialize.  This aids in debugging complex
  server configurations, where the failure of a single handler to start
  is easy to overlook.
- Added "prefix" property to fileHandler.  For some reason, it was missing.
  This provides the equivalent functionallity to the apache "alias"
  function

- modified TemplateRunner to enhance method access to document
- Added HighlightTemplate to rewrite html/xml based on regular expressions

Created a change-log file to document all significant changes made to 
Brazil/naws since the "public" release.  *Please* keep this file up to date.
 
Added a make target and tcl script to make it easier to extract info for
the change-log file from the sccs files.

added includeDir option to include a nav bar entry for url's that
end in /

Fixed init bug that caused a failure on 1st request.
- if log=5, tracebacks are generated on python internal errors

removed dead code

Integrate Colin's changes
- BasicAuthHandler - subst() move
- ResourceHandler - subst() move
- Request.java - remove dead code
- CachManager - remove printf's

fix "array out of bounds" exception when cgi script generates 
bogus output

Tcl script that changes log messages (level 4 and 5) into comments, 
thus removing the overhead of computing the log messages

PropsTemplate.subst() and PropsTemplate.getProperty() moved to the Format
class.

added "subtype" parameter to allow other mime subtypes other than html to
be processed (still needs to be text/?? though).

ContentTemplate now looks at HTTP-EQUIV meta tags, and places the 
corrosponding entry into the request headers

Misc. handler updates
- ConfigFileHandler can update properties that match a pattern, even if
  they are not in the default config file (which is now optional)
- UrlMapperHandler can export sub-matches of the url to request props
- AclSwitchHandler can use regular expression patterns instead of url
  prefixes to match credentials

add "sunlabs" to list of buildable directories.
This contains the ChownHandler that uses the native code from the
JavaWebServer(tm) to allow the server to chown() and chgrp() itself

fixed bug delivering non-readable files

Moved sunlabs required functionallity out of the special "main" program,
and into the "ChownHandler", so the sunlabs web site can use the 
standard jar file

Added build for python

Moved python template into python directory
note: still has unresolved initilaization issues

- added python handler to Makefile
- fixed handler so "print" statements in the python code are interted into the html document
- changed example (python.config python.html) to demonstrate getting and setting server properties

see previous putback (I can't type)
This is *TEMPORARILY* in the TCL directory 'cause I copied the implementation from the
TCL template

first pass at a python template.
- need to hack python jar file to capture the return value
- uses the jpython.jar file in jarslibsdlls

Added PropertiesHandler.
Returns selected request properties as text/plain documents

New SessionManager (installable as a handler)
that uses a pool of hashtables to prevent the number of sessions
from growing without bound.
 
It uses a simplified toss-least-used algorithm

New handler to deal with url's that end in '/'

Added java code for tini board:
- fridge.eng code
- sample tini web based development environment

Put documentation in the code describing the problem with the Cookie header:
   
> Blank characters at end of "Cookie" HTTP header were causing some HTTP servers
> to be confused and generate an error return.  Specifically, this seemed to
> happen to Microsoft-IIS HTTP servers when issuing a POST to an .asp file.

Blank characters at end of "Cookie" HTTP header were causing some HTTP servers
to be confused and generate an error return.  Specifically, this seemed to
happen to Microsoft-IIS HTTP servers when issuing a POST to an .asp file.

Some servers send "HTTP/1.0 100 Continue" in response to an HTTP/1.1 POST!

Main.main() and ResourceHandler.getResourceStream() didn't work under
Windows due to platform-dependant file names.  Class.getResourceAsStream()
requires '/' as separator, while File.getParent() requires '\'.  Added code
to turn '/' into '\' and vice versa as necessary.  Both methods now accept
either '\' or '/' in file names and/or resource names.

removed  System.out.println(s)

doc changes (mostly)

Added sample demonstrating BSL using ${} on if and foreach, and sort key

bug fix - only worked on 1st page
Also works as a handler

doc fixes for [] -> ${} change

Although HTTP/1.1 chunking spec says that there is one "\r\n" between
chunks, some servers (for example, maps.yahoo.com) may send more than one
blank line between chunks.  So, read and skip all the blank lines seen
between chunks.

- fixed sql test case to use new ${} syntax
- added test case for the DirectoryTemplate

Replace "[xxx]" syntax for embedded property names with "${xxx}" syntax,
since "[" and "]" were already used by "glob=" and "match=" in BSL.  Escaping
the "[" characters was uglier than expected, and "${}" syntax matches how
the csh, sh, Tcl, and make parsers reference variables.

Added a "DirectoryTemplate" that (hopefully) obsoletes the DirectoryHandler
and works better with BSL

Server object is in RewriteContext used by templates, so templates (such as
the TclServerTemplate) can be initialized with the server and prefix, similar
to how Handlers are initialized.
  
BasicAuthHandler was giving misleading error message indicating that it
couldn't load the mapfile even if no mapfile was specified.
  
PropsTemplate and BSLTemplate allow '[' and ']' to specify a variable
substitution wherever a constant was used before.  For example, as in
'<if name=stock value="[favorite]">' to compare the value of property "stock"
not to the constant "[favorite]", but to the value of the property "favorite".
In order to include a literal "[" in an option, use "\[" -- a backslash
escapes the following character, whatever it is.
  
TclServerTemplate can load init script from resource fork or file system.
TclServerTemplate passes "server" and "prefix" to init script.

interim changes

If "name=" was misspelled in <property> tag, NullPointerException.

added a couple more properties by default, including the url and the method

expose handler prefix.
expose request and prefix to init script

doc fixes

new sample config

added sample sql config

- cleaned up lots of documentation
- renamed HtmlRewrite ->RewriteContext and BasicSessionHandler->BasicAuthHandler
- rewrote PublishHandler, restoring the old semantics

moved stuff out of makefile.common to here

- filters were processing content type incorrectly, by not handling (options)
  trailing parameters.
- Changed the way the TOC and UrlNavBar templates return properties, for
  better integration with BSL
- added javadoc comments
- added better logging diagnostics

- doc fixes.  JavaDocs now build with no warnings
- BasicSessionHandler, AclSwitchHandler, and Roles handler work again

Main:
- documentation for "root" resolution behavior
- the "jar" file is searched for config files if not found in filesystem
- The server class can be specified as a property
Server
- null constructor allows servers to be created with newInstance()

"root" property was being resolved w.r.t. the wrong base path.  The 
"root" property is now combined with the base path of the config file that
specified that "root", not with the base path of the last config file seen
(which might be in a different directory).
  
If the "root" property is specified on the command line after the config file,
then that property still wins and is used as is.

Fixed chaining in ConfigFileHandler (needed to change Connection,Request too)
Removed unneeded server dependencies

added diagnostics to indicate where files are found
removed options from filehandler
 - deny: use UrlMapperHandler
 - request: use FilterHandler
removed unused bufSize from sendFile

created new "deferred handler" that initializes another handler, but
only when it is first needed.  Also provides for class dependency
checking, eliminating Class Not Found errors.

Removed property chaining, restoring the old copying behaviour.
until I can figure out whats broken

- removed cookie processing cofde: usa a sessionHandler instead
- removed undocumented "handler" option: use the TemplateFilter instead

- added "setProps" option to DirectoryHandler to allow results
  to be placed in the request properties (see config.new_dir)
- Added "delim=" option to BSL <foreach list|property..> to specify
  token delimiters in property lists
- Changed PRoxyProperties handler to allow prefixes to be added before
  data is placed into properties
- Changed configFileHandler to use ChainedPRoperties
- Added config file to test new DirectoryHandler properties

updated documentation, added connection re-tries

1st pass SQL template using jdbc and mySql

stuff for running samples for Palm.

bugs when converting from using "Cookie" header to using Session ID.

doc fixes so pdf generation succeeds

added sample portal configuration

the "gotCookie" property, used by the ConfigFileHandler got lost
in the shuffle, I added it back in.
 
FormTemplate wasn't handling radio buttons properly

sorting properties in <foreach> tag.  Not currently documented, putback so
people can try it.

doc fixes

fixed DEPENDS in Makefiles, added javadoc comments

CookieFilter:
A separate "Cookie" header was sent for each cookie being sent to the target.
Yahoo Mail requires all cookies sent in a request to concatenated together in
a single "Cookie" header.
  
TclFilter, TclHandler:
Moved to sunlabs.brazil.tcl package.
  
SessionFilter -> UrlSessionFilter
  
UrlSessionFilter:
correctly handles returning URLs with "#" in them.
  
Palm/nametool: eliminate NametoolHandler.java, which was just to grep the
"nameslistx" file for matching employees.  Do search directly from the
<server language=tcl> script.

removed redundant templates

minor fixes to Makefiles to account for new name changes

1. Restore MapPage.java
  
2. Add copyright notices to (most of) the handlers.
  
3. Rename AuthHandler to BasicSessionHandler.
   Rename SessionHandler to CookieSessionHandler.
   (update your config files.)

Don't compile SerialPersist unless sun.misc classes needed are available

Basic documentation was missing for Server, ChainHandler, Request
  
Request.java: 
1. Made request Properties a rechainable Properties object.
2. Replaced DataOutputStream with HttpOutputStream.
  
Rename "tail" directory and TailHandler.java to "filter" directory and
FilterHandler.java.
  
FilterHandler.java:
1. configuration property "wrap" -> "handler"
2. configuration property "filter" -> "filters"
3. Now that the HTTP response headers is a first-class object, rewrote
   FilterHandler so that it doesn't have to re-extract the headers from the
   output stream of the wrapped handler.
4. Disable chunked encoding before requesting data that will be filtered.
  
TemplateHandler.java, TemplateFilter.java:
1. configuration property "templateClass" -> "templates"
  
AuthHandler.java:
1. Handles authentication via 401 or 407 (Proxy-Authentication).
  
ResourceHandler.java:
1. Exposes public method to get contents of files from the resource file.
  
DynamicConfigHandler.java
1. Uses rechainable Properties object to insert new Server properties behind
   the Request properties before dispatching to the wrapped handler's respond
   method.
  
HttpInputStream.java:
1. Streaming media didn't work because data from server wasn't flushed to
   client until the end of the request.
  
CookieMonster renamed to CookieFilter.
  
CookieFilter.java: 
1. converted to a Filter; as a Filter, the CookieFilter can use an
   arbitrary authentication scheme and be combined with any number of other
   content filters.  
2. uses SessionManager to hold cookies instead of accessing PJama directly.
  
PropsTemplate.java:
1. exposes public method to parse and dereference composed property
   names (using the '[' and ']' characters).  Method is used by BSLTemplate.
  
SessionManager.java rewritten to allow runtime selection of different
SessionManagers.  Now specific session manager can be chosen in the "init=
" line of the config file.  Previously, had to compile various files that
all impersonated "sunlabs.brazil.handler.SessionManager" and set classpath
to point to the desired one.  Now there are three implementations of the
SessionManager:  
1. SessionManager:      Default session manager, no persistence.
2. PJamaSessionManager: Using PJama.
3. SerialPersist:       Using Serializable and ObjectOutputStream.

Didn't mean to put this file back yet.  Removed changes that are preventing
compiling with rest of naws.

some more comments on the NametoolHandler

hide deleted files.

NametoolHandler.java:
Round 1.
  
DynamicConfigHandler.java:
Round 1.
  
DirectoryHandler.java:
NullPointerException if directory had no files in it or was not readable.
  
ResourceHandler.java:
NullPointerException if file resource was not found in .jar file
  
PropsTemplate.java:
Use pattern of the form [XXX] to substitute in the value of a property in
the middle of another property in the <property> tag.
  
ChainHandler.java:
If handler threw an exception while being initialized by ChainHandler, the
ChainHandler would print an error message, but subsequently still dispatch
HTTP requests to it.

- fixed proxyHandler
- added FilterProxyHandler to provide a simple add-removing proxy
- patched bugs in the GenericProxyHandler where headers weren't
  being processed properly
- doc changes and minor fixes

added filter to copy the contents of a web site

minor changes do to the GE demo
- virtual hosts can now be mounted at /
- loggin messages changes
- template runner now handles comment tags
- configFileHandler glob matching for "set" fixed

added the Brazil tini development environment to the workspace

added documentation, re-did "register" button

Handler to rempa or redirect url's based on regular expressions

The GE refrigerator demo

If </if> was missing, BSL template got a null-pointer exception.

??

pJama version of persistent state

fixed bugs in multiproxyhandler
- other sites can now be mounted at "/"
- added debuggin to url rewriting (use log>5)
can now specify content type for proxyProperties to handler
ContentTemplate now deals with javascript in the document "head"

forgot this one!

Claim these 3 templates are serializable
This allow us to test the experimental serializing persistent session
handler

Added BSL to several of the html pages for the demo kit, while
making changes for Bert. The changes are extenisve in appearance
but offer little new functionality other than.

	Card and OpenCard status always displayed
	Application specific html code for each card is no possible
	Redid Several of the purchase forms.


PKCS
	Second interation of the PKCS11 UPI service

CI
	First version of Conceptual Indexing Web based Unser interface


	Various other build local or remote issues.

1st pass at creating a version of SessionManager that does persistence, 
by "serializing" everything in its session table, and writing it out to a file

- Missing close() on templateHandler
- forgot to strip off optional ";" at end of cookie value
  in SessionHandler

removed platform dependancy on redirect check

renamed RemoteStsHAndler to ProxyPropertiesHandler.
This handler proxies to a remote web site.  If the resultant content
is text/plain, it loads the result as java properties into the
request object.  Otherwise it passes the content through unchanged

1st pass at an SMTP handler for sending email

Removed the use of the FileHandler to retrieve the
contents of the template

Properties we not being passed on if a "set" was atempted, and no
values were changed

Add BSL support fix some issues raised by users.

The template handler is (incorrectly) using the FileHandler to read its
templates.  Until this is changed, I put in a "hack" to trick the
file-handler into working properly - again

- fixed bug in cgi handler - it got the script name wrong
- The configFileHandler was setting the request properties BEFORE processing
  the query data
- The ContentTemplate now extracts javascript scripts in the <head> and
  places them in a "script" property

Added make target and accessories needed to genrate a
pdf version of our javadoc documentation.  See the Makefile for
more information

- rewrote ConFigFileHandler to minimize the number of config files
  created
- fixed some diagnostic messages

documentation.
  
Tests for ChainHandler.

Merge with Colin's last putback
Added project for Neil's website

fix wildcard imports
  
expunge Server.initHandler and Server.initObject.

Issues with Thread.interrupt() vs. Thread.stop().
1. Thread.interrupt() doesn't interrupt I/O in jdk-1.1.5
2. Thread.stop() is OK to use (ignore deprecation warnings), but makes it
   difficult to write test scripts -- Thread.interrupt() only interrupts the
   response thread at known places, so a known number of log messages can
   be examined.
3. Thread.interrupt() generates different log messages under jdk-1.1
   and jdk-1.2, making it harder to write portable test scripts.  Suppress
   the differences.
  
---------------------------------------------------------------------------
StringMap:
  
1. Rename "getValue" to "get" to make it more compatible with Dictionary
naming scheme.
  
---------------------------------------------------------------------------
Connection.java:
  
1. Name printed for thread in log message when a connection is accepted
   should agree with the name printed for the thread when the Request does
   something.
  
2. When sending 404 to client, the log message should indicate the filename.
  
3. Thread.interrupt() issues interacting with the test scripts.
  
---------------------------------------------------------------------------
FileHandler.java:
  
1. documentation.
  
2. "blockSize" property was retrieved from Properties but never used, since
   the copy operation uses the Server.bufsize.  "blockSize" removed.
  
3. "deny" property to deny access to files that matched a glob pattern was
   broken.  Arguments to Glob were reversed, so the code was treating the 
   URL as the pattern and the deny pattern as the filename.  No matches.
  
4. URL was never "URL decoded", so something like "/in%64ex%2ehtml"
   was not converted to "/index.html".  Code would therefore look for the
   existence of a file called "in%64ex%2ehtml".  
  
5. java.net.URL was used to convert a URL to the local file name.  However,
   java.net.URL does not collapse a trailing "/.." (or "/.") in the URL,
   leading to the possibility of escaping from the document root.
  
6. In jdk-1.2, java.io.File collapses out multiple consecutive "/" characters
   in a file name, while in jdk-1.1, this doesn't happen.  It is necessary
   to take them out to make it easier to compare if two files are the
   same.
  
7. Request property "fileName" is set to the name of the file being 
   fetched.  But if the user requested a directory name, and the 
   FileHandler automatically filled in the name of the index file (e.g., 
   index.html), "fileName" should have been set to the that file, not
   just the name of the directory.
  
8. After appending the name of the index file onto the name of the
   directory requested in an URL, the FileHandler didn't ensure that that
   file existed (and was a regular file).  This would cause a
   FileNotFoundException, and the server would either send a "500 Server
   Error" or just close the connection back to the client.  Instead, it
   should return a "404 Not Found" message.
  
---------------------------------------------------------------------------
Request.java:
  
1. If the "Content-Length" provided in the request was malformed, the
   log message should display how it was malformed.
  
2. If Request.sendError() was called, it was logging the word "null"
   if the user passed in null for the detail message.  Aesthetically 
   displeasing.
  
3. If Request.sendError() is called when part of a response has already
   been sent, it cannot send the error headers and error message, because
   that would confuse things, so it must just close the connection.  That
   was done right, but it wasn't bumping the Server.errorCount.  It still
   should do that always.
  
---------------------------------------------------------------------------
Server.java:
  
1. Name printed for thread in log message when a connection is accepted
   should agree with the name printed for the thread when the Request does
   something.
  
2. Thread.interrupt() issues interacting with the test scripts.
  
---------------------------------------------------------------------------
defs:
  
env(TCL_CLASSPATH) can be set to the path to find additional classes (such
as everything in sunlabs.brazil.*) that was not in env(CLASSPATH) when the
JVM was started up.
  
However, we cannot use TCL_CLASSPATH because some of the code (in both tcl
and Java) uses Class.forName(), which doesn't go through the TclClassLoader
to find the class we are referencing.  Instead the CLASSPATH has to be
setup before running the tests because the JVM won't pick up changes to
the CLASSPATH variable after it's running.
  
---------------------------------------------------------------------------
MimeHeaders.java
  
Bug used to cause continuation line to be added to the _first_ occurrence of
the key, not the most recent occurence (namely, the previous line).

- New "main" that allows change-user requests on solaris, using the
  "server.so" file that comes with the JWS/2.0.  The properties are:
  "userName" and "groupName"
 
- Date template that substitutes dates into html using strftime()
  format strings

start of tests.
 
fixing bugs revealed by writing tests.

Directory for sunlabs.eng specific handlers for Brazil

added option to PropsTemplate to place query parameters and
mime headers into request properties before the template is processed

MultiHostHandler

documentation assembly stuff

added "interfaceHost" option to main to better support multi-homes machines

Move HttpRequest to separate directory from rest of util.

look for root property within prefix first

ChangedTemplate.

Eliminate public methods Server.initHandler() and Server.initObject().
  
Get rid of public variables Request.server and Request.sock:
A. In all cases, Request.server was not necessary; it was mainly used for
   constructing the absolute URL for a redirect, so Request.redirect() was
   rewritten to take an absolute or relative URL and do the right thing.
B. Request.sock was changed to Request.getSock(); it is still rarely used
   for diagnostics and logging (e.g., ChainSawHandler).
  
Change name of RemoteHandler to ProxyHandler, since it is an "HTTP Proxy",
not an "HTTP Remote", whatever that is.
  
Change GenericProxyHandler (which actually filters data from other sites, and
is not a proxy at all) to use Request.sendResponse(InputStream, ...) to
stream the data, instead of fetching the entire contents into a big byte array
and then sending the byte array to Request.sendResponse(byte[], ...).
  
Changed TclServerTemplate and BSLTemplate to use the config parameter "debug"
to decide whether to emit comments into the resultant HTML file.
  
Eliminate unused SocketFactory.newSocket(InetAddress, int) method.
  
HTTP request returned ungracefully if "Content-Length" in a POST was 
negative or too much to allocate.
  
ChainSawHandler: header must be spelled as "Referer".
  
Change MimeHeaders so it uses "put" instead of "set", to be compatible with
names chosen by Hashtable and StringMap.

filehandler dodn't send content length!!

Sample BSL document.

The BSL files weren't checked in.

BSL Template.
  
TemplateHandler now takes a list of Templates, rather than just one.  When
parsing an HTML file, it will now dispatch to the union of all the tag
methods defined in the list of Templates.  In that way, the user can
compose things like the BSLTemplate to iterate over request properties with
the PropsTemplate to substitute in their values.  Otherwise, it would have
required N separate passes (via N separate TemplateHandlers) over the HTML
file, one for each Template and/or level of recursion in the BSLTemplate.
  
HtmlRewriter didn't re-emit parsed comments as comments.
  
Added ability to change a tag into a comment.  Used by BSL and Tcl templates,
to keep track of where the substitution occurred when examining the resultant
HTML document.
  
TclServerTemplate: added configuration property to source an initialization
script into the Tcl Interp the first time the Interp is used.

fixed wildcarded imports

Rename tclHandlers directory to tcl, since it has more than just handlers.

Differentiate between "connection refused" and "unknown host" when attempting
to communicate via sun itelnet proxy.
  
Define Request.toString().
  
TclServerTemplate: parses HTML file for <server language="tcl"> tag and
runs associated Tcl script.
  
StringMap.toString crashed if no entries were in the StringMap.

Lots more documentation.
  
Added a convenience method to Request to send a response from an input
stream.  This method should have been in there a long time ago.  Now the
user doesn't have to copy all the data into a string or byte array and then
copy it all back out again.  RemoteHandler uses this method to sling the
data from the remote site back to the client site.  FileHandler uses this
method to send the data from the FileInputStream to the client.
  
Move logic for removing point-to-point headers into the HttpRequest as a
static convenience method.
  
Handle malformed URLs that have spaces in the name.  These type of URLS are
sent by RealAudio clients.  HTTP request line parsing is actually simpler now.
  
ChainHandler crashed if no "handlers" specified.
  
Connection was leaking threads.
  
Main runs all the classes specified in the "init" line in the config file
before starting the server.
  
Server.initFields removed
  
Server.initHandler and Server.initObject have extensive documentation now
that will hopefully make their existence compelling.
  
LexHTML uses a method to set the special tags like <script> and <style>,
instead of a global property.
  
Fold TimedThread and the default HttpSocketPool into the HttpRequest file,
since they are not used outside of this file (at this time).
  
HttpUtil.urlEncode was wrong.

update to new mimeHeader semantics (and test of putback notices)

Integrated colin's changes

Documentation for HtmlRewriter, Glob, HttpRequest (in progress),
HttpInputStream.
  
Make HttpSocketPool a public interface so that users of HttpRequest can
implement it to provide their own cache and policy.
  
javadoc lint.
  
LexHTML automatically lower-cases reported tag name, for backwards
compatibility with HtmlMunge, so user can call String.equals() instead of
String.equalsIgnoreCase()

??

Change logging to show prefix of Handler generating the log message.
  
Documentation for LexML and StringMap.

Re-do server logging (partly done)
empty queries are "" not null

added toString methods
removed wildcarded imports

Codemgr_wsdata/putback.cmt

Improperly quoting and dequoting HTML tag attributes led to forms/templates
not working.
  
Better error message if couldn't connect because machine wasn't listening
on specified port, rather than saying "unknown host".

Replace HtmlMunge with LexML and LexHTML, that correctly parse HTML.
  
New HtmlRewriter object, that allows arbitrary rewriting of the HTML (by
templates and others), instead of forcing the templates to return a string
that contained all of the new HTML content in one new big string.
  
Move TemplateHandler to the sunlabs.brazil.template package, with all the
templates that use it.
  
Rewrite RemoteHandler (proxy) to use HttpRequest.
  
Consistent way of initializing Handlers and other things that want to get
attributes from the config file.  Convenience method that constructs the
object, sets (via reflection) all the variables in the object that correspond
to values specified in the config file, and then calls init() on the object.

Move Makefile.common use to top of this workspace and remove workspace specific
Remove Workspace specific items from Makefile.common redo makefiles to be relative
n the use of Makefile.common.

Please stop using Makefile.common in the lib directory.

Rewriting the server to make it easier to separate out the functionality 
required for acting as a proxy.  Also separated out some common functionality
that was not server-specific, such as the concept of a MimeHeaders object
so that we don't continuously tie ourselves to a specific implementation.

created a place to put all the package doc files needed by javadoc.
I suppose they could be spread out in each package, but it seems more
convenient to keep them all in one spot

Redo DEPENDS rules to support smaller util directiories
Add Support for RSA
Add Support for JINI requires 1.2 putting in a check to allow system to continue
if you start the config file with 1.1.x.
More testing and html clean up

Change Regexp.sub(String, String) so that it returns the changed string if
there was a match and null if there was no match.
  
Regexp.match with a pattern that had '$' at the end was broken.

- fixed proxy handlers to work with tail handlers
- added table-of-contents extractor template
- modified HtmlMunge for table-of-content extractor

Updated to next version:
 - each tail filter can run multiple tail filters
 - ReplaceFilter permits templace substitutions

Add support for new security directories
Add support for RC4 on Java Card
Add some test pages

Regsub.submatch would crash if specified subregion didn't exist.

regsub entered infinite loop if pattern matched the empty string.
  
subspec previously only allowed \ followed by a number to specify a 
substring.  Should have also allowed any other char after \ to mean literal.

Sort and Regexp for java.

Application Service Provider Conversion Services
This sub directory contains a handler that converts .doc files to .pdf
files. The handler uses software form http://www.nevaobjects.com to
manipualte COM objects on Windows.  The functionality here could be 
greatly expanded in that we would provide ULR mappings to any COM
server if we had the time to write a conversion program.

CorporateCard and CorporateCardAccess have been modified to reduce
memory consumption and implement correct XOR signing algorithm.

Cards can check signatures on card.

Prepared classes for addition of RSA signing, DSS and RC4 decryption.

Handlers moved to sunlabs.brazil.sts.... and sunlabs.brazil.cardhandlers...

Error processing for  CorporateCard APDUs fixed so error messages are correct

Removed Message digest checks and secret from client handlers.

Added convenience mathod for emitting response when content is a byta array

typo in Sort.java?

Regexp, Glob, and Sort.

This putback includes a number of changes.

We can build two distributions in the naws/pcsdemo and the naws/ directory these distributions are for all of the pcs demos and just the core handler. Both of the distributions can be built by typing make dist in the directory.  Once the
distributions are built they are on www.digiorgio.com and www.cv360428-norwlk1.ct.home.com. Unlder /brazil/all and /brazil/core respectively.

The make dist procedure requires that you enter passwords for the certificates. We can give you the password.  There is a problem with later versions of netscape when building test certificates for your own use. This problem is unresolved at the current time. You will not be able to give your certificate a nicname therefore the makefile will not be able to automatically sing your test applets.jar file.

Building the SmartCard UPI and or Core from the workspaces
Bring the following workspaces over to a local machine 

naws
sts
jarslibsdll
applets 
opencard

Before building you need to get signing certificates for 
External Signing certificate for https://www.digiorgio.com 
Get brazil-pcs-digiorgio-signer.p12 
Internal Signing certificate for https://mack.eng 
Get brazil-pcs-mack-signer.p12 
Install the certificates, remember your password. You will be asked to supply it twice. Please contact Stephen x63252 or Rinaldo 203-255-6781 to get a password for the above certificates. To build the pcsdemo cd to naws/pcsdemo and type make. You will be prompted for a signing certificate password.To build the website software which includes the doc directory, the applets and the cardlets. Type make website and if you want to test. To make a distribution type make -e dist.

- moved pjama wrappers into util directory
- changed all glob users to use util version
- changed DirectoryHandler to use sort in util directory
- changed tcl Handler to create on interpreter per session, allowing
  for better concurrency, and updated sample handler to use it
- fixed minor bug in Glob
- integrated rinaldo's ConfigFileManager changes
  + should be re-implemented to not read the config file on every
    request

2nd pass at content post-processing
 
- Filter interface is now a subclass of Handler.  This allows filters
  to look at (and possibly modify) requests before the content-to-be
  fitlered is fetched by the wrapped handler
- modified sample filters to conform to new interface
- write TclFilter, to allow content filters to be written in tcl
- wrote SessionFilter, allowind session info to be encoded in url's, 
  eliminating the need for browser cookies

beginnings of a util directory for common utilities

added "PushHandler" as a starting point for handling multipart/form data
for the document conversion demo
 
The multipart/form processor needs to be rewritten to be
robust, and then integrated into thr request object, so any
handler can deal with multipart/form data transparently.
 
This is temporary.  Cheers

Add support for distribution of an unsigned jar file so that 
users installing the server kit can install it by providing the
required signing certificates.

added "listenQueue" option to Main, to set the initial server socket listenQ
added flush() call after request headers are emitted.  This is used
(incorrectly) by the TailHandler to identify the end of the headers.

first attempt at a handler that allows filtering of already processed
ouput.  Its purpose is to help noodle about the proper way
to restructure naws co this isn't so kludgy

Support a welcome page, iconify start scripts, change config to support
no default configuration, Remove spelling errors add some more docs

HTML changes
Support a local config file handler on the local machine for configuration.
Remove Pin frompurse balance check.

Limited the max # of threads the server will create (defaults to 250).

- put cgi scripts (including java servlet runner) into a separate directory
- added javaDocs to tclHandler

Add more options to the download pages and provide more feedback on errors. Correct error with profile load.

Correct default settings for configuration and error checks for Bcard.

Update HTML doc and add absolute InstallAnywhere fix
taype make editia to bring up installer editor then select existing and advanced mode

Add html configuration of ports using ConfigHandler, documentation

the "redirect" config parameter is looked-up in the form data/ config file
first.  If not found, it is used as the redirect target

- fixed publish handler to use ACL returned by AuthHandler
- Updated makefile to provide targets to add documents into the jar file
- updated the sample config file

add handler for reading documents out of the jar file

Main initializes the config file with the resource:
/sunlabs/brazil/server/config on startup.
 
This allows default server configurations to be included in the jar
file, so that "java -jar server.jar" becomes a self contained
application

Created a three step process once InstallAnywhere has put the bits on the disk.

	First page at doc root has poitners for external and internal
	certificates and link to step 2.


	This steps allows user to change the configuration form html.
	The Opencard handlers was changed to support the construction
	of OpenCard.terminals from OpenCard.device and OpenCard.driver.

	A test page that allow user to stop and start openCard without
	restarting the server so that properties can be changed 
	interactively.

	InstallAnywhere tests, html changes.

Add processing for <option> tags

sample config file for proxying a single entire site

Change the way redirects work to use the host header field as available

redo of config-file handler to make it more useful

Consistency Check

merge finished
 - added serveral handlers
 - make small updates to core server code
 - re-organized handlers to extract generic functionallity into separate classes

Consistency Check

Continue a long series of putbacks that add the following:
  o Code Signing of applets removing need for preferences.js
  o Major reindentation of code to Sun Style ( there are options for every ones style)
    Please excuse any changes to source code that you had near and dear -- The tool
    should be able to support your style.  ( All methods have stubs for docs)
  o Config file specification for atrs and aids
  o Removal of all awt dependencies from card server -- moved to browser
  o Creation of small standalone demo directory with clear seperation of client
    and server.
  o Moved stsHandlers and cardHandlers to sts directory
  o added mulitple selections for download
  o versions of different cards supported
  o aid display
  o crude file deletion mechanism
  o New Install Anywehre procedure supports three types of pacakges
  o naws directory leve one is only naws
  o Pin Support
  o Removal of several hundred extraneous files
Do not do a bringover until I have built everything on mack.eng, I plan to complete this before 
12:00 or so Califronia time.