SCM

SCM Repository

[tm] Diff of /pkg/ChangeLog
ViewVC logotype

Diff of /pkg/ChangeLog

Parent Directory Parent Directory | Revision Log Revision Log | View Patch Patch

trunk/R/textmin/ChangeLog revision 59, Tue Sep 26 12:24:09 2006 UTC trunk/tm/ChangeLog revision 825, Sat Feb 23 09:47:28 2008 UTC
# Line 1  Line 1 
1    2008-02-23  Ingo Feinerer  <h0125130@wu-wien.ac.at>
2    
3            * man/: Language codes should be in ISO 639-1 format.
4    
5    2008-01-31  Ingo Feinerer  <h0125130@wu-wien.ac.at>
6    
7            * R/textdoccol.R (writeCorpus): Function for writing a corpus
8            containing plain text documents to disk.
9    
10    2008-01-30  Ingo Feinerer  <h0125130@wu-wien.ac.at>
11    
12            * R/termdocmatrix.R (TermDocMatrix): Ensure that dimnames are
13            always set correctly.
14    
15            * R/textdoccol.R: Set load = TRUE as default for load on demand
16            since in most cases this is the wanted behaviour.
17    
18    2008-01-24  Ingo Feinerer  <h0125130@wu-wien.ac.at>
19    
20            * R/: Renamed TextDocCol to Corpus, and Corpus to Content.
21    
22            * DESCRIPTION: Updated Version to 0.3 due to core name changes.
23    
24    2008-01-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
25    
26            * R/meta.R (meta): New function for consistent access to meta data
27            of document collections, repositories, and texts.
28    
29    2008-01-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
30    
31            * R/: Better support for encodings.
32    
33    2008-01-13  Ingo Feinerer  <h0125130@wu-wien.ac.at>
34    
35            * R/textdoccol.R (TextDocCol): Fixed bug regarding default reader
36            selection when no reader argument is given.
37    
38    2008-01-05  Ingo Feinerer  <h0125130@wu-wien.ac.at>
39    
40            * R/source.R (CSVSource): Now uses read.csv instead of scan
41            internally.
42    
43    2008-01-02  Ingo Feinerer  <h0125130@wu-wien.ac.at>
44    
45            * R/reader.R (getReaders): Returns available reader functions.
46    
47            * R/termdocmatrix.R (TermDocMatrix): Set new modular constructor
48            as default.
49    
50    2007-12-02  Ingo Feinerer  <h0125130@wu-wien.ac.at>
51    
52            * R/stopwords.R (stopwords): Shortened code, removed codetools
53            variable warnings.
54    
55            * man/: Documentation for showMeta, added an example for tmMap.
56    
57            * inst/doc/tm.Rnw: Updated vignette, comments on MS word reader,
58            some minor typos fixed.
59    
60    2007-12-01  Ingo Feinerer  <h0125130@wu-wien.ac.at>
61    
62            * R/aobjects.R (showMeta): Added method for pretty printing a
63            text document's meta data.
64    
65    2007-11-29  Ingo Feinerer  <h0125130@wu-wien.ac.at>
66    
67            * R/textdoccol.R (TextDocCol): Better handling of empty
68            arguments.
69    
70            * NAMESPACE: Exported readDOC.
71    
72            * man/completeStems.Rd: Added an example.
73    
74    2007-11-18  Ingo Feinerer  <h0125130@wu-wien.ac.at>
75    
76            * R/stopwords.R (stopwords): Look up .dat files at every
77            call. Allows users to modify stopword .dat files interactively.
78    
79    2007-11-06  Ingo Feinerer  <h0125130@wu-wien.ac.at>
80    
81            * R/termdocmatrix.R (termFreq): Correct processing of empty
82            documents.
83    
84    2007-10-27  Ingo Feinerer  <h0125130@wu-wien.ac.at>
85    
86            * man/: Updated documentation.
87    
88    2007-10-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
89    
90            * R/complete.R (completeStems): Completes (heuristically) word
91            stems.
92    
93            * R/termdocmatrix.R (TermDocMatrix2): New modular
94            constructor.
95    
96            * NAMESPACE: Exported termFreq.
97    
98    2007-10-16  Ingo Feinerer  <h0125130@wu-wien.ac.at>
99    
100            * R/reader.R (readDOC): Added MS Word reader (using antiword).
101    
102    2007-10-14  Ingo Feinerer  <h0125130@wu-wien.ac.at>
103    
104            * R/weight.R: Weighting functions for TermDocMatrix.
105    
106    2007-10-13  Ingo Feinerer  <h0125130@wu-wien.ac.at>
107    
108            * R/termdocmatrix.R (dimnames, colnames, rownames): Wrapper
109            functions for accessing dimension, column, and row names.
110    
111            * R/plot.R (plot.TermDocMatrix): Plot correlations between terms.
112    
113    2007-09-11  Ingo Feinerer  <h0125130@wu-wien.ac.at>
114    
115            * man/removePunctuation.Rd: Added documentation. Function also exported to NAMESPACE.
116    
117    2007-08-28  Ingo Feinerer  <h0125130@wu-wien.ac.at>
118    
119            * R/fungen.R: Use S4 class for function generators instead of S3 attributes.
120    
121    2007-07-29  Ingo Feinerer  <h0125130@wu-wien.ac.at>
122    
123            * R/reader.R (readPDF): Removed manual checks for pdftotext and
124            pdfinfo. The system call gives a warning anyway.
125    
126    2007-07-28  Ingo Feinerer  <h0125130@wu-wien.ac.at>
127    
128            * R/textdoccol.R (asPlain): Conversion from
129            StructuredTextDocuments to PlainTextDocuments.
130    
131    2007-07-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
132    
133            * R/termdocmatrix.R: Added convenience methods ("[", nrow, ncol)
134            for accessing term-document matrices.
135    
136            * inst/doc/tm.Rnw: readPDF is only called if pdftotext and pdfinfo
137            are installed.
138    
139    2007-07-17  Ingo Feinerer  <h0125130@wu-wien.ac.at>
140    
141            * R/termdocmatrix.R (TermDocMatrix): Improved efficiency. Kudos to
142            Christian Buchta.
143    
144    2007-07-15  Ingo Feinerer  <h0125130@wu-wien.ac.at>
145    
146            * inst/doc/tm.Rnw: Update vignette (readPDF, readHTML, preprocessReut21578XML).
147    
148    2007-07-14  Ingo Feinerer  <h0125130@wu-wien.ac.at>
149    
150            * R/reader.R (readHTML): Added very simple HTML reader to obtain StructuredTextDocuments.
151    
152            * R/reader.R (readPDF): Added PDF reader.
153    
154    2007-07-13  Ingo Feinerer  <h0125130@wu-wien.ac.at>
155    
156            * DESCRIPTION: Moved proxy from Depends to Imports to avoid name clashes.
157    
158            * inst/stopwords/english.dat: Added the term "yes" to stopwords.
159    
160            * R/termdocmatrix.R (dim): dim function for TermDocMatrix.
161    
162            * R/preprocess.R (convertMboxEml): Accepts gzipped mboxes.
163    
164    2007-07-11  Ingo Feinerer  <h0125130@wu-wien.ac.at>
165    
166            * R/distmeasure.R (dissimilarity): Replaced dists call from
167            package cba by new dist call from package proxy.
168    
169    2007-07-10  Ingo Feinerer  <h0125130@wu-wien.ac.at>
170    
171            * inst/doc/tm.Rnw: Described removeSparseTerms and Dictionary.
172    
173    2007-06-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
174    
175            * R/termdocmatrix.R: require() uses the quietly option to suppress
176            loading messages.
177    
178    2007-06-12  Ingo Feinerer  <h0125130@wu-wien.ac.at>
179    
180            * R/dictionary.R: Added dictionary support.
181    
182    2007-06-07  Ingo Feinerer  <h0125130@wu-wien.ac.at>
183    
184            * R/aobjects.R: Added classes for Reuters21578 XML and RCV1
185            documents. This simplifies some functions, e.g., asPlain.
186    
187    2007-06-06  Ingo Feinerer  <h0125130@wu-wien.ac.at>
188    
189            * inst/doc/tm.Rnw: Fixed some typos in vignette.
190    
191    2007-06-03  Ingo Feinerer  <h0125130@wu-wien.ac.at>
192    
193            * R/textdoccol.R (replaceWords): Added method to replace a set of
194            words by a single word. Useful for synonyms.
195    
196    2007-05-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
197    
198            * man/TermDocMatrix.Rd: Fixed documentation on Data slot.
199    
200    2007-05-19  Ingo Feinerer  <h0125130@wu-wien.ac.at>
201    
202            * R/termdocmatrix.R (textvector): Small fix for dealing with empty
203            vectors. Thanks to Ariel Maguyon for his error report.
204            (removeSparseTerms): New function to remove columns from a
205            term-document matrix exceeding a sparse factor.
206    
207    2007-05-15  Ingo Feinerer  <h0125130@wu-wien.ac.at>
208    
209            * man/tmUpdate.Rd: Corrected documentation on readerControl parameter.
210    
211    2007-05-11  Ingo Feinerer  <h0125130@wu-wien.ac.at>
212    
213            * man/sFilter.Rd: Corrected documentation on statement format (use
214            '==' instead of '=').
215    
216    2007-05-08  Ingo Feinerer  <h0125130@wu-wien.ac.at>
217    
218            * R/aobjects.R (StructuredTextDocument): Inherits from
219            TextDocument.
220    
221    2007-05-04  Ingo Feinerer  <h0125130@wu-wien.ac.at>
222    
223            * R/termdocmatrix.R (findFreqTerms): Perform efficient computation
224            on sparse matrices as proposed by Martin Maechler.
225    
226    2007-04-27  Ingo Feinerer  <h0125130@wu-wien.ac.at>
227    
228            * R/textdoccol.R: Removed \code{dbDisconnect} calls since last
229            \pkg{filehash} version makes them deprecated.
230    
231    2007-04-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
232    
233            * R/termdocmatrix.R (textvector): Stemming is now performed before
234            erasing stopwords.
235            (weightMatrix): Adapted to handle sparse matrices.
236            (TermDocMatrix): Sparse matrix is now efficiently built by
237            direct stepwise insertion of row values into it.
238    
239    2007-04-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
240    
241            * DESCRIPTION: Replaced \pkg{filehashSQLite} with \pkg{filehash}
242            due to ongoing problems. For our purposes the latter is as useful
243            as the replaced package.
244    
245    2007-04-20  Ingo Feinerer  <h0125130@wu-wien.ac.at>
246    
247            * man/TextDocCol.Rd: Replaced \code{readPlain} with \code{object@DefaultReader}.
248    
249            * man/TermDocMatrix.Rd: Remove deprecated \code{language} argument.
250    
251    2007-04-15  Ingo Feinerer  <h0125130@wu-wien.ac.at>
252    
253            * R/resolve.R (resolveISOCode): Added ISO 639-1 codes for
254            languages with available stopwords.
255    
256    2007-04-14  Ingo Feinerer  <h0125130@wu-wien.ac.at>
257    
258            * inst/doc/tm.Rnw: Minor corrections in the vignette.
259    
260    2007-04-11  Ingo Feinerer  <h0125130@wu-wien.ac.at>
261    
262            * DESCRIPTION: Update to version 0.2, since a lot of new features
263            have been integrated.
264    
265            * inst/stopwords: Updated existing stopwords and added stopwords
266            for various other languages.
267    
268    2007-04-10  Ingo Feinerer  <h0125130@wu-wien.ac.at>
269    
270            * man/: Updated documentation.
271    
272            * Work/testDb.R: Script to test database stuff.
273    
274            * R/: Fixed various database related bugs. Seems to be rather
275            useable now, i.e., consider as alpha status for now.
276    
277    2007-04-08  Ingo Feinerer  <h0125130@wu-wien.ac.at>
278    
279            * R/: Fixed some bugs related to database support.
280    
281    2007-04-07  Ingo Feinerer  <h0125130@wu-wien.ac.at>
282    
283            * man/: Added a lot of examples to the manuals.
284    
285    2007-04-05  Ingo Feinerer  <h0125130@wu-wien.ac.at>
286    
287            * man/: Updated parts of the documentation.
288    
289            * R/textdoccol.R (asPlain): Added conversion from newsgroup
290            documents to plain text documents.
291    
292    2007-04-01  Ingo Feinerer  <h0125130@wu-wien.ac.at>
293    
294            * R/textdoccol.R: Finished experimental database support. Not yet
295            intensively tested.
296    
297            * R/source.R: Now each source has a default reader.
298    
299            * R/reader.R: \code{FunctionGenerator} is now an attribute, not a
300            class anymore.
301    
302            * R/plaintextdoc.R: Custom show method for plain text documents.
303    
304            * R/aobjects.R: Added a class for structured text documents.
305    
306            * R/reader.R: Replaced remaining \code{parser} occurrences with
307            \code{reader}.
308    
309            * R/textdoccol.R (summary): Indent tags.
310    
311            * R/textdoccol.R (removePunctuation): Transform method to remove
312            punctuation marks.
313    
314    2007-03-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
315    
316            * R/textdoccol.R (sFilter): Simplified sFilter significantly by
317            using prescindMeta().
318    
319    2007-03-18  Ingo Feinerer  <h0125130@wu-wien.ac.at>
320    
321            * R/textdoccol.R: Improved database support.
322    
323    2007-03-16  Ingo Feinerer  <h0125130@wu-wien.ac.at>
324    
325            * R/termdocmatrix.R (TermDocMatrix): Uses sparse matrices.
326    
327            * R/resolve.R (resolveISOcode): Extracts the language from a ISO
328            language code.
329    
330            * R/textdoccol.R (TextDocCol): Refactored several parser arguments
331            into parserControl argument.
332    
333            * R/aobjects.R (TextDocument): Introduced the "Language" slot.
334    
335    2007-03-14  Ingo Feinerer  <h0125130@wu-wien.ac.at>
336    
337            * Work/tmDataSetup.R: The datasets acq and crude can now be
338            created on the fly.
339    
340            * R/stopwords.R: Introduced a function returning the stopwords for
341            a given language (English, German and French at the moment)
342    
343            * R/textdoccol.R (stemDoc): Stemming uses Rstem if available,
344            otherwise falls back to Snowball package.
345    
346    2007-01-30  Ingo Feinerer  <h0125130@wu-wien.ac.at>
347    
348            * man/dissimilarity-methods.Rd: Make clear that any method offered
349            by "dists" from package "cba" can be used.
350    
351    2007-01-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
352    
353            * inst/doc/tm.Rnw: Fixed quotes-appearing-as-boxes-bug according
354            to Kurt's latex suggestion. Removed points and underscores in
355            variable names for consistent naming.
356    
357            * DESCRIPTION: Update to version 0.1-2.
358    
359            * man/TextRepository.Rd: Fixed bug in documentation.
360    
361    2007-01-12  Ingo Feinerer  <h0125130@wu-wien.ac.at>
362    
363            * DESCRIPTION: Update to version 0.1-1.
364    
365    2007-01-09  Ingo Feinerer  <h0125130@wu-wien.ac.at>
366    
367            * R/textdoccol.R (stemDoc): Use Rstem::wordStem instead of
368            wordStem.
369    
370    2007-01-06  Ingo Feinerer  <h0125130@wu-wien.ac.at>
371    
372            * R/: Changes due to Kurt's review.
373    
374    2006-12-31  Ingo Feinerer  <h0125130@wu-wien.ac.at>
375    
376            * R/: Implemented improvements based upon comments by David
377            Meyer.
378    
379    2006-12-17  Ingo Feinerer  <h0125130@wu-wien.ac.at>
380    
381            * inst/doc/: Rewrote vignette.
382    
383            * man/: Improved documentation.
384    
385    2006-12-16  Ingo Feinerer  <h0125130@wu-wien.ac.at>
386    
387            * man/: Updated documentation.
388    
389            * DESCRIPTION: Changed package name to "tm". Updated version to
390            0.1 for first CRAN release.
391    
392            * inst/texts/gmane.comp.lang.r.general.mbox: mbox Gmane R mailing
393            list archive example.
394    
395            * inst/texts/gmane.comp.lang.r.gr.rdf: RSS Gmane R mailing list
396            archive example.
397    
398            * R/preprocess.R (convert_mbox_eml): A simple e-mail converter
399            from (several mails per box) mbox format to (single mail per file)
400            eml format.
401    
402    2006-12-08  Ingo Feinerer  <h0125130@wu-wien.ac.at>
403    
404            * data/crude.rda: Rebuilt.
405    
406            * data/acq.rda: Rebuilt.
407    
408            * R/reader.R: Factored out reader and parser methods from
409            textdoccol.R.
410    
411            * R/source.R: Factored out Source methods from aobjects.R and
412            textdoccol.R.
413            (GmaneRSource): Encapsulates Gmane R mailing list archive RSS
414            feeds.
415    
416            * R/textdoccol.R (DirSource): Added support for recursive
417            traversal of directories.
418    
419    2006-12-07  Ingo Feinerer  <h0125130@wu-wien.ac.at>
420    
421            * R/textdoccol.R ([[): Loads the document corpus automatically
422            into memory upon access.
423            (tm_transform, tm_filter): Removed several checks whether the
424            document is already loaded ([[ ensures this now).
425            (gmane_r_reader): Reader for RSS feeds as provided by the Gmane R
426            mailing list archive.
427    
428    2006-12-06  Ingo Feinerer  <h0125130@wu-wien.ac.at>
429    
430            * R/aobjects.R (TextDocument): Is now a virtual class.
431            (Source): Is now a virtual class.
432    
433    2006-12-05  Ingo Feinerer  <h0125130@wu-wien.ac.at>
434    
435            * R/textdoccol.R (c): Support for an arbitrary number of document
436            collections.
437    
438    2006-11-26  Ingo Feinerer  <h0125130@wu-wien.ac.at>
439    
440            * R/textrepo.R: Updated TextRepository (constructor), append_elem,
441            append_meta and remove_meta.
442    
443            * R/textdoccol.R: Removed modify_metadata method.
444    
445            * R/textrepo.R: Removed modify_metadata method.
446    
447            * R/textdoccol.R (remove_meta): Supports removal of document
448            collection metadata and document (= in data frame) metadata.
449    
450    2006-11-23  Ingo Feinerer  <h0125130@wu-wien.ac.at>
451    
452            * R/textdoccol.R (append_doc): Bug fix for handling empty metadata.
453    
454            * data/crude.rda: Rebuilt.
455    
456            * data/acq.rda: Rebuilt.
457    
458            * inst/doc/textmin.Rnw: Updated vignette to reflect code changes.
459    
460            * R/textdoccol.R ([): Bug fix for subsetting a document
461            collection's data frame.
462    
463    2006-11-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
464    
465            * R/textdoccol.R: Bug fixes in s_filter. Added full query support
466            to s_filter.
467    
468            * R/textdoccol.R: Local text documents' metadata can now be copied
469            to a document collection's data frame with prescind_meta.
470    
471    2006-11-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
472    
473            * R/: Text documents' slot metadata is now accessible in s_filter.
474    
475            * R/: Rewrote s_filter function (has still some restrictions).
476    
477    2006-11-20  Ingo Feinerer  <h0125130@wu-wien.ac.at>
478    
479            * R/: Various fixes in handling metadata.
480    
481            * R/: Added update mechanism for text document collections.
482    
483    2006-11-19  Ingo Feinerer  <h0125130@wu-wien.ac.at>
484    
485            * R/: Merging of document collections now creates a binary tree
486            for reconstructing merged document collections.
487    
488            * R/: Redesign of metadata for document collections.
489    
490    2006-11-07  Ingo Feinerer  <h0125130@wu-wien.ac.at>
491    
492            * R/: Messages now use \code{ngettext}.
493    
494    2006-11-03  Ingo Feinerer  <h0125130@wu-wien.ac.at>
495    
496            * R/: Added functions for modifying and removing metadata.
497    
498    2006-11-01  Ingo Feinerer  <h0125130@wu-wien.ac.at>
499    
500            * man/: Updated some documentation.
501    
502            * R/: Corrected some connection issues.
503    
504            * inst/doc: Worked on the vignette.
505    
506    2006-10-31  Ingo Feinerer  <h0125130@wu-wien.ac.at>
507    
508            * inst/: Added texts and started vignette.
509    
510            * R/: Final changes based upon David's comments.
511    
512    2006-10-29  Ingo Feinerer  <h0125130@wu-wien.ac.at>
513    
514            * NAMESPACE: Corrected exports (generic methods need exportMethods
515            directives!).
516    
517    2006-10-26  Ingo Feinerer  <h0125130@wu-wien.ac.at>
518    
519            * R/: Modified the TextDocCol constructur and various parsers. It
520            is now modular and supports various file formats via plugins (see
521            the new "Source" class).
522    
523    2006-10-24  Ingo Feinerer  <h0125130@wu-wien.ac.at>
524    
525            * man/: Revised documentation after previous code changes.
526    
527    2006-10-23  Ingo Feinerer  <h0125130@wu-wien.ac.at>
528    
529            * R/: Remaining changes as discussed with David.
530    
531    2006-10-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
532    
533            * R/: Some changes as suggested by David. The rest will follow
534            within the next days.
535    
536  2006-09-26  Ingo Feinerer  <h0125130@wu-wien.ac.at>  2006-09-26  Ingo Feinerer  <h0125130@wu-wien.ac.at>
537    
538          * man/: Finished documentation.          * man/: Finished documentation.

Legend:
Removed from v.59  
changed lines
  Added in v.825

root@r-forge.r-project.org
ViewVC Help
Powered by ViewVC 1.0.0  
Thanks to:
Vienna University of Economics and Business Powered By FusionForge