SCM

SCM Repository

[tm] Diff of /trunk/tm/ChangeLog
ViewVC logotype

Diff of /trunk/tm/ChangeLog

Parent Directory Parent Directory | Revision Log Revision Log | View Patch Patch

trunk/R/textmin/ChangeLog revision 67, Wed Nov 1 17:29:59 2006 UTC trunk/tm/ChangeLog revision 833, Fri Mar 21 10:55:11 2008 UTC
# Line 1  Line 1 
1    2008-03-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
2    
3            * R/textdoccol.R (materialize, tmMap): Improvements suggested by
4            Christian Buchta.
5    
6            * inst/CITATION: Added template to include JSS article reference.
7    
8    2008-03-12  Ingo Feinerer  <h0125130@wu-wien.ac.at>
9    
10            * R/textdoccol.R (tmMap): Introduced lazy mapping.
11    
12            * R/source.R: Added VectorSource.
13    
14    2008-02-23  Ingo Feinerer  <h0125130@wu-wien.ac.at>
15    
16            * man/: Language codes should be in ISO 639-1 format.
17    
18            * R/textdoccol.R (asPlain): Preserve local meta data.
19    
20    2008-01-31  Ingo Feinerer  <h0125130@wu-wien.ac.at>
21    
22            * R/textdoccol.R (writeCorpus): Function for writing a corpus
23            containing plain text documents to disk.
24    
25    2008-01-30  Ingo Feinerer  <h0125130@wu-wien.ac.at>
26    
27            * R/termdocmatrix.R (TermDocMatrix): Ensure that dimnames are
28            always set correctly.
29    
30            * R/textdoccol.R: Set load = TRUE as default for load on demand
31            since in most cases this is the wanted behaviour.
32    
33    2008-01-24  Ingo Feinerer  <h0125130@wu-wien.ac.at>
34    
35            * R/: Renamed TextDocCol to Corpus, and Corpus to Content.
36    
37            * DESCRIPTION: Updated Version to 0.3 due to core name changes.
38    
39    2008-01-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
40    
41            * R/meta.R (meta): New function for consistent access to meta data
42            of document collections, repositories, and texts.
43    
44    2008-01-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
45    
46            * R/: Better support for encodings.
47    
48    2008-01-13  Ingo Feinerer  <h0125130@wu-wien.ac.at>
49    
50            * R/textdoccol.R (TextDocCol): Fixed bug regarding default reader
51            selection when no reader argument is given.
52    
53    2008-01-05  Ingo Feinerer  <h0125130@wu-wien.ac.at>
54    
55            * R/source.R (CSVSource): Now uses read.csv instead of scan
56            internally.
57    
58    2008-01-02  Ingo Feinerer  <h0125130@wu-wien.ac.at>
59    
60            * R/reader.R (getReaders): Returns available reader functions.
61    
62            * R/termdocmatrix.R (TermDocMatrix): Set new modular constructor
63            as default.
64    
65    2007-12-02  Ingo Feinerer  <h0125130@wu-wien.ac.at>
66    
67            * R/stopwords.R (stopwords): Shortened code, removed codetools
68            variable warnings.
69    
70            * man/: Documentation for showMeta, added an example for tmMap.
71    
72            * inst/doc/tm.Rnw: Updated vignette, comments on MS word reader,
73            some minor typos fixed.
74    
75    2007-12-01  Ingo Feinerer  <h0125130@wu-wien.ac.at>
76    
77            * R/aobjects.R (showMeta): Added method for pretty printing a
78            text document's meta data.
79    
80    2007-11-29  Ingo Feinerer  <h0125130@wu-wien.ac.at>
81    
82            * R/textdoccol.R (TextDocCol): Better handling of empty
83            arguments.
84    
85            * NAMESPACE: Exported readDOC.
86    
87            * man/completeStems.Rd: Added an example.
88    
89    2007-11-18  Ingo Feinerer  <h0125130@wu-wien.ac.at>
90    
91            * R/stopwords.R (stopwords): Look up .dat files at every
92            call. Allows users to modify stopword .dat files interactively.
93    
94    2007-11-06  Ingo Feinerer  <h0125130@wu-wien.ac.at>
95    
96            * R/termdocmatrix.R (termFreq): Correct processing of empty
97            documents.
98    
99    2007-10-27  Ingo Feinerer  <h0125130@wu-wien.ac.at>
100    
101            * man/: Updated documentation.
102    
103    2007-10-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
104    
105            * R/complete.R (completeStems): Completes (heuristically) word
106            stems.
107    
108            * R/termdocmatrix.R (TermDocMatrix2): New modular
109            constructor.
110    
111            * NAMESPACE: Exported termFreq.
112    
113    2007-10-16  Ingo Feinerer  <h0125130@wu-wien.ac.at>
114    
115            * R/reader.R (readDOC): Added MS Word reader (using antiword).
116    
117    2007-10-14  Ingo Feinerer  <h0125130@wu-wien.ac.at>
118    
119            * R/weight.R: Weighting functions for TermDocMatrix.
120    
121    2007-10-13  Ingo Feinerer  <h0125130@wu-wien.ac.at>
122    
123            * R/termdocmatrix.R (dimnames, colnames, rownames): Wrapper
124            functions for accessing dimension, column, and row names.
125    
126            * R/plot.R (plot.TermDocMatrix): Plot correlations between terms.
127    
128    2007-09-11  Ingo Feinerer  <h0125130@wu-wien.ac.at>
129    
130            * man/removePunctuation.Rd: Added documentation. Function also exported to NAMESPACE.
131    
132    2007-08-28  Ingo Feinerer  <h0125130@wu-wien.ac.at>
133    
134            * R/fungen.R: Use S4 class for function generators instead of S3 attributes.
135    
136    2007-07-29  Ingo Feinerer  <h0125130@wu-wien.ac.at>
137    
138            * R/reader.R (readPDF): Removed manual checks for pdftotext and
139            pdfinfo. The system call gives a warning anyway.
140    
141    2007-07-28  Ingo Feinerer  <h0125130@wu-wien.ac.at>
142    
143            * R/textdoccol.R (asPlain): Conversion from
144            StructuredTextDocuments to PlainTextDocuments.
145    
146    2007-07-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
147    
148            * R/termdocmatrix.R: Added convenience methods ("[", nrow, ncol)
149            for accessing term-document matrices.
150    
151            * inst/doc/tm.Rnw: readPDF is only called if pdftotext and pdfinfo
152            are installed.
153    
154    2007-07-17  Ingo Feinerer  <h0125130@wu-wien.ac.at>
155    
156            * R/termdocmatrix.R (TermDocMatrix): Improved efficiency. Kudos to
157            Christian Buchta.
158    
159    2007-07-15  Ingo Feinerer  <h0125130@wu-wien.ac.at>
160    
161            * inst/doc/tm.Rnw: Update vignette (readPDF, readHTML, preprocessReut21578XML).
162    
163    2007-07-14  Ingo Feinerer  <h0125130@wu-wien.ac.at>
164    
165            * R/reader.R (readHTML): Added very simple HTML reader to obtain StructuredTextDocuments.
166    
167            * R/reader.R (readPDF): Added PDF reader.
168    
169    2007-07-13  Ingo Feinerer  <h0125130@wu-wien.ac.at>
170    
171            * DESCRIPTION: Moved proxy from Depends to Imports to avoid name clashes.
172    
173            * inst/stopwords/english.dat: Added the term "yes" to stopwords.
174    
175            * R/termdocmatrix.R (dim): dim function for TermDocMatrix.
176    
177            * R/preprocess.R (convertMboxEml): Accepts gzipped mboxes.
178    
179    2007-07-11  Ingo Feinerer  <h0125130@wu-wien.ac.at>
180    
181            * R/distmeasure.R (dissimilarity): Replaced dists call from
182            package cba by new dist call from package proxy.
183    
184    2007-07-10  Ingo Feinerer  <h0125130@wu-wien.ac.at>
185    
186            * inst/doc/tm.Rnw: Described removeSparseTerms and Dictionary.
187    
188    2007-06-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
189    
190            * R/termdocmatrix.R: require() uses the quietly option to suppress
191            loading messages.
192    
193    2007-06-12  Ingo Feinerer  <h0125130@wu-wien.ac.at>
194    
195            * R/dictionary.R: Added dictionary support.
196    
197    2007-06-07  Ingo Feinerer  <h0125130@wu-wien.ac.at>
198    
199            * R/aobjects.R: Added classes for Reuters21578 XML and RCV1
200            documents. This simplifies some functions, e.g., asPlain.
201    
202    2007-06-06  Ingo Feinerer  <h0125130@wu-wien.ac.at>
203    
204            * inst/doc/tm.Rnw: Fixed some typos in vignette.
205    
206    2007-06-03  Ingo Feinerer  <h0125130@wu-wien.ac.at>
207    
208            * R/textdoccol.R (replaceWords): Added method to replace a set of
209            words by a single word. Useful for synonyms.
210    
211    2007-05-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
212    
213            * man/TermDocMatrix.Rd: Fixed documentation on Data slot.
214    
215    2007-05-19  Ingo Feinerer  <h0125130@wu-wien.ac.at>
216    
217            * R/termdocmatrix.R (textvector): Small fix for dealing with empty
218            vectors. Thanks to Ariel Maguyon for his error report.
219            (removeSparseTerms): New function to remove columns from a
220            term-document matrix exceeding a sparse factor.
221    
222    2007-05-15  Ingo Feinerer  <h0125130@wu-wien.ac.at>
223    
224            * man/tmUpdate.Rd: Corrected documentation on readerControl parameter.
225    
226    2007-05-11  Ingo Feinerer  <h0125130@wu-wien.ac.at>
227    
228            * man/sFilter.Rd: Corrected documentation on statement format (use
229            '==' instead of '=').
230    
231    2007-05-08  Ingo Feinerer  <h0125130@wu-wien.ac.at>
232    
233            * R/aobjects.R (StructuredTextDocument): Inherits from
234            TextDocument.
235    
236    2007-05-04  Ingo Feinerer  <h0125130@wu-wien.ac.at>
237    
238            * R/termdocmatrix.R (findFreqTerms): Perform efficient computation
239            on sparse matrices as proposed by Martin Maechler.
240    
241    2007-04-27  Ingo Feinerer  <h0125130@wu-wien.ac.at>
242    
243            * R/textdoccol.R: Removed \code{dbDisconnect} calls since last
244            \pkg{filehash} version makes them deprecated.
245    
246    2007-04-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
247    
248            * R/termdocmatrix.R (textvector): Stemming is now performed before
249            erasing stopwords.
250            (weightMatrix): Adapted to handle sparse matrices.
251            (TermDocMatrix): Sparse matrix is now efficiently built by
252            direct stepwise insertion of row values into it.
253    
254    2007-04-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
255    
256            * DESCRIPTION: Replaced \pkg{filehashSQLite} with \pkg{filehash}
257            due to ongoing problems. For our purposes the latter is as useful
258            as the replaced package.
259    
260    2007-04-20  Ingo Feinerer  <h0125130@wu-wien.ac.at>
261    
262            * man/TextDocCol.Rd: Replaced \code{readPlain} with \code{object@DefaultReader}.
263    
264            * man/TermDocMatrix.Rd: Remove deprecated \code{language} argument.
265    
266    2007-04-15  Ingo Feinerer  <h0125130@wu-wien.ac.at>
267    
268            * R/resolve.R (resolveISOCode): Added ISO 639-1 codes for
269            languages with available stopwords.
270    
271    2007-04-14  Ingo Feinerer  <h0125130@wu-wien.ac.at>
272    
273            * inst/doc/tm.Rnw: Minor corrections in the vignette.
274    
275    2007-04-11  Ingo Feinerer  <h0125130@wu-wien.ac.at>
276    
277            * DESCRIPTION: Update to version 0.2, since a lot of new features
278            have been integrated.
279    
280            * inst/stopwords: Updated existing stopwords and added stopwords
281            for various other languages.
282    
283    2007-04-10  Ingo Feinerer  <h0125130@wu-wien.ac.at>
284    
285            * man/: Updated documentation.
286    
287            * Work/testDb.R: Script to test database stuff.
288    
289            * R/: Fixed various database related bugs. Seems to be rather
290            useable now, i.e., consider as alpha status for now.
291    
292    2007-04-08  Ingo Feinerer  <h0125130@wu-wien.ac.at>
293    
294            * R/: Fixed some bugs related to database support.
295    
296    2007-04-07  Ingo Feinerer  <h0125130@wu-wien.ac.at>
297    
298            * man/: Added a lot of examples to the manuals.
299    
300    2007-04-05  Ingo Feinerer  <h0125130@wu-wien.ac.at>
301    
302            * man/: Updated parts of the documentation.
303    
304            * R/textdoccol.R (asPlain): Added conversion from newsgroup
305            documents to plain text documents.
306    
307    2007-04-01  Ingo Feinerer  <h0125130@wu-wien.ac.at>
308    
309            * R/textdoccol.R: Finished experimental database support. Not yet
310            intensively tested.
311    
312            * R/source.R: Now each source has a default reader.
313    
314            * R/reader.R: \code{FunctionGenerator} is now an attribute, not a
315            class anymore.
316    
317            * R/plaintextdoc.R: Custom show method for plain text documents.
318    
319            * R/aobjects.R: Added a class for structured text documents.
320    
321            * R/reader.R: Replaced remaining \code{parser} occurrences with
322            \code{reader}.
323    
324            * R/textdoccol.R (summary): Indent tags.
325    
326            * R/textdoccol.R (removePunctuation): Transform method to remove
327            punctuation marks.
328    
329    2007-03-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
330    
331            * R/textdoccol.R (sFilter): Simplified sFilter significantly by
332            using prescindMeta().
333    
334    2007-03-18  Ingo Feinerer  <h0125130@wu-wien.ac.at>
335    
336            * R/textdoccol.R: Improved database support.
337    
338    2007-03-16  Ingo Feinerer  <h0125130@wu-wien.ac.at>
339    
340            * R/termdocmatrix.R (TermDocMatrix): Uses sparse matrices.
341    
342            * R/resolve.R (resolveISOcode): Extracts the language from a ISO
343            language code.
344    
345            * R/textdoccol.R (TextDocCol): Refactored several parser arguments
346            into parserControl argument.
347    
348            * R/aobjects.R (TextDocument): Introduced the "Language" slot.
349    
350    2007-03-14  Ingo Feinerer  <h0125130@wu-wien.ac.at>
351    
352            * Work/tmDataSetup.R: The datasets acq and crude can now be
353            created on the fly.
354    
355            * R/stopwords.R: Introduced a function returning the stopwords for
356            a given language (English, German and French at the moment)
357    
358            * R/textdoccol.R (stemDoc): Stemming uses Rstem if available,
359            otherwise falls back to Snowball package.
360    
361    2007-01-30  Ingo Feinerer  <h0125130@wu-wien.ac.at>
362    
363            * man/dissimilarity-methods.Rd: Make clear that any method offered
364            by "dists" from package "cba" can be used.
365    
366    2007-01-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
367    
368            * inst/doc/tm.Rnw: Fixed quotes-appearing-as-boxes-bug according
369            to Kurt's latex suggestion. Removed points and underscores in
370            variable names for consistent naming.
371    
372            * DESCRIPTION: Update to version 0.1-2.
373    
374            * man/TextRepository.Rd: Fixed bug in documentation.
375    
376    2007-01-12  Ingo Feinerer  <h0125130@wu-wien.ac.at>
377    
378            * DESCRIPTION: Update to version 0.1-1.
379    
380    2007-01-09  Ingo Feinerer  <h0125130@wu-wien.ac.at>
381    
382            * R/textdoccol.R (stemDoc): Use Rstem::wordStem instead of
383            wordStem.
384    
385    2007-01-06  Ingo Feinerer  <h0125130@wu-wien.ac.at>
386    
387            * R/: Changes due to Kurt's review.
388    
389    2006-12-31  Ingo Feinerer  <h0125130@wu-wien.ac.at>
390    
391            * R/: Implemented improvements based upon comments by David
392            Meyer.
393    
394    2006-12-17  Ingo Feinerer  <h0125130@wu-wien.ac.at>
395    
396            * inst/doc/: Rewrote vignette.
397    
398            * man/: Improved documentation.
399    
400    2006-12-16  Ingo Feinerer  <h0125130@wu-wien.ac.at>
401    
402            * man/: Updated documentation.
403    
404            * DESCRIPTION: Changed package name to "tm". Updated version to
405            0.1 for first CRAN release.
406    
407            * inst/texts/gmane.comp.lang.r.general.mbox: mbox Gmane R mailing
408            list archive example.
409    
410            * inst/texts/gmane.comp.lang.r.gr.rdf: RSS Gmane R mailing list
411            archive example.
412    
413            * R/preprocess.R (convert_mbox_eml): A simple e-mail converter
414            from (several mails per box) mbox format to (single mail per file)
415            eml format.
416    
417    2006-12-08  Ingo Feinerer  <h0125130@wu-wien.ac.at>
418    
419            * data/crude.rda: Rebuilt.
420    
421            * data/acq.rda: Rebuilt.
422    
423            * R/reader.R: Factored out reader and parser methods from
424            textdoccol.R.
425    
426            * R/source.R: Factored out Source methods from aobjects.R and
427            textdoccol.R.
428            (GmaneRSource): Encapsulates Gmane R mailing list archive RSS
429            feeds.
430    
431            * R/textdoccol.R (DirSource): Added support for recursive
432            traversal of directories.
433    
434    2006-12-07  Ingo Feinerer  <h0125130@wu-wien.ac.at>
435    
436            * R/textdoccol.R ([[): Loads the document corpus automatically
437            into memory upon access.
438            (tm_transform, tm_filter): Removed several checks whether the
439            document is already loaded ([[ ensures this now).
440            (gmane_r_reader): Reader for RSS feeds as provided by the Gmane R
441            mailing list archive.
442    
443    2006-12-06  Ingo Feinerer  <h0125130@wu-wien.ac.at>
444    
445            * R/aobjects.R (TextDocument): Is now a virtual class.
446            (Source): Is now a virtual class.
447    
448    2006-12-05  Ingo Feinerer  <h0125130@wu-wien.ac.at>
449    
450            * R/textdoccol.R (c): Support for an arbitrary number of document
451            collections.
452    
453    2006-11-26  Ingo Feinerer  <h0125130@wu-wien.ac.at>
454    
455            * R/textrepo.R: Updated TextRepository (constructor), append_elem,
456            append_meta and remove_meta.
457    
458            * R/textdoccol.R: Removed modify_metadata method.
459    
460            * R/textrepo.R: Removed modify_metadata method.
461    
462            * R/textdoccol.R (remove_meta): Supports removal of document
463            collection metadata and document (= in data frame) metadata.
464    
465    2006-11-23  Ingo Feinerer  <h0125130@wu-wien.ac.at>
466    
467            * R/textdoccol.R (append_doc): Bug fix for handling empty metadata.
468    
469            * data/crude.rda: Rebuilt.
470    
471            * data/acq.rda: Rebuilt.
472    
473            * inst/doc/textmin.Rnw: Updated vignette to reflect code changes.
474    
475            * R/textdoccol.R ([): Bug fix for subsetting a document
476            collection's data frame.
477    
478    2006-11-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
479    
480            * R/textdoccol.R: Bug fixes in s_filter. Added full query support
481            to s_filter.
482    
483            * R/textdoccol.R: Local text documents' metadata can now be copied
484            to a document collection's data frame with prescind_meta.
485    
486    2006-11-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
487    
488            * R/: Text documents' slot metadata is now accessible in s_filter.
489    
490            * R/: Rewrote s_filter function (has still some restrictions).
491    
492    2006-11-20  Ingo Feinerer  <h0125130@wu-wien.ac.at>
493    
494            * R/: Various fixes in handling metadata.
495    
496            * R/: Added update mechanism for text document collections.
497    
498    2006-11-19  Ingo Feinerer  <h0125130@wu-wien.ac.at>
499    
500            * R/: Merging of document collections now creates a binary tree
501            for reconstructing merged document collections.
502    
503            * R/: Redesign of metadata for document collections.
504    
505    2006-11-07  Ingo Feinerer  <h0125130@wu-wien.ac.at>
506    
507            * R/: Messages now use \code{ngettext}.
508    
509    2006-11-03  Ingo Feinerer  <h0125130@wu-wien.ac.at>
510    
511            * R/: Added functions for modifying and removing metadata.
512    
513  2006-11-01  Ingo Feinerer  <h0125130@wu-wien.ac.at>  2006-11-01  Ingo Feinerer  <h0125130@wu-wien.ac.at>
514    
515          * man/: Updated some documentation.          * man/: Updated some documentation.

Legend:
Removed from v.67  
changed lines
  Added in v.833

root@r-forge.r-project.org
ViewVC Help
Powered by ViewVC 1.0.0  
Thanks to:
Vienna University of Economics and Business Powered By FusionForge