SCM

SCM Repository

[tm] Diff of /pkg/ChangeLog
ViewVC logotype

Diff of /pkg/ChangeLog

Parent Directory Parent Directory | Revision Log Revision Log | View Patch Patch

trunk/R/textmin/ChangeLog revision 59, Tue Sep 26 12:24:09 2006 UTC trunk/tm/ChangeLog revision 831, Wed Mar 12 09:10:46 2008 UTC
# Line 1  Line 1 
1    2008-03-12  Ingo Feinerer  <h0125130@wu-wien.ac.at>
2    
3            * R/textdoccol.R (tmMap): Introduced lazy mapping.
4    
5    2008-02-23  Ingo Feinerer  <h0125130@wu-wien.ac.at>
6    
7            * man/: Language codes should be in ISO 639-1 format.
8    
9            * R/textdoccol.R (asPlain): Preserve local meta data.
10    
11    2008-01-31  Ingo Feinerer  <h0125130@wu-wien.ac.at>
12    
13            * R/textdoccol.R (writeCorpus): Function for writing a corpus
14            containing plain text documents to disk.
15    
16    2008-01-30  Ingo Feinerer  <h0125130@wu-wien.ac.at>
17    
18            * R/termdocmatrix.R (TermDocMatrix): Ensure that dimnames are
19            always set correctly.
20    
21            * R/textdoccol.R: Set load = TRUE as default for load on demand
22            since in most cases this is the wanted behaviour.
23    
24    2008-01-24  Ingo Feinerer  <h0125130@wu-wien.ac.at>
25    
26            * R/: Renamed TextDocCol to Corpus, and Corpus to Content.
27    
28            * DESCRIPTION: Updated Version to 0.3 due to core name changes.
29    
30    2008-01-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
31    
32            * R/meta.R (meta): New function for consistent access to meta data
33            of document collections, repositories, and texts.
34    
35    2008-01-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
36    
37            * R/: Better support for encodings.
38    
39    2008-01-13  Ingo Feinerer  <h0125130@wu-wien.ac.at>
40    
41            * R/textdoccol.R (TextDocCol): Fixed bug regarding default reader
42            selection when no reader argument is given.
43    
44    2008-01-05  Ingo Feinerer  <h0125130@wu-wien.ac.at>
45    
46            * R/source.R (CSVSource): Now uses read.csv instead of scan
47            internally.
48    
49    2008-01-02  Ingo Feinerer  <h0125130@wu-wien.ac.at>
50    
51            * R/reader.R (getReaders): Returns available reader functions.
52    
53            * R/termdocmatrix.R (TermDocMatrix): Set new modular constructor
54            as default.
55    
56    2007-12-02  Ingo Feinerer  <h0125130@wu-wien.ac.at>
57    
58            * R/stopwords.R (stopwords): Shortened code, removed codetools
59            variable warnings.
60    
61            * man/: Documentation for showMeta, added an example for tmMap.
62    
63            * inst/doc/tm.Rnw: Updated vignette, comments on MS word reader,
64            some minor typos fixed.
65    
66    2007-12-01  Ingo Feinerer  <h0125130@wu-wien.ac.at>
67    
68            * R/aobjects.R (showMeta): Added method for pretty printing a
69            text document's meta data.
70    
71    2007-11-29  Ingo Feinerer  <h0125130@wu-wien.ac.at>
72    
73            * R/textdoccol.R (TextDocCol): Better handling of empty
74            arguments.
75    
76            * NAMESPACE: Exported readDOC.
77    
78            * man/completeStems.Rd: Added an example.
79    
80    2007-11-18  Ingo Feinerer  <h0125130@wu-wien.ac.at>
81    
82            * R/stopwords.R (stopwords): Look up .dat files at every
83            call. Allows users to modify stopword .dat files interactively.
84    
85    2007-11-06  Ingo Feinerer  <h0125130@wu-wien.ac.at>
86    
87            * R/termdocmatrix.R (termFreq): Correct processing of empty
88            documents.
89    
90    2007-10-27  Ingo Feinerer  <h0125130@wu-wien.ac.at>
91    
92            * man/: Updated documentation.
93    
94    2007-10-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
95    
96            * R/complete.R (completeStems): Completes (heuristically) word
97            stems.
98    
99            * R/termdocmatrix.R (TermDocMatrix2): New modular
100            constructor.
101    
102            * NAMESPACE: Exported termFreq.
103    
104    2007-10-16  Ingo Feinerer  <h0125130@wu-wien.ac.at>
105    
106            * R/reader.R (readDOC): Added MS Word reader (using antiword).
107    
108    2007-10-14  Ingo Feinerer  <h0125130@wu-wien.ac.at>
109    
110            * R/weight.R: Weighting functions for TermDocMatrix.
111    
112    2007-10-13  Ingo Feinerer  <h0125130@wu-wien.ac.at>
113    
114            * R/termdocmatrix.R (dimnames, colnames, rownames): Wrapper
115            functions for accessing dimension, column, and row names.
116    
117            * R/plot.R (plot.TermDocMatrix): Plot correlations between terms.
118    
119    2007-09-11  Ingo Feinerer  <h0125130@wu-wien.ac.at>
120    
121            * man/removePunctuation.Rd: Added documentation. Function also exported to NAMESPACE.
122    
123    2007-08-28  Ingo Feinerer  <h0125130@wu-wien.ac.at>
124    
125            * R/fungen.R: Use S4 class for function generators instead of S3 attributes.
126    
127    2007-07-29  Ingo Feinerer  <h0125130@wu-wien.ac.at>
128    
129            * R/reader.R (readPDF): Removed manual checks for pdftotext and
130            pdfinfo. The system call gives a warning anyway.
131    
132    2007-07-28  Ingo Feinerer  <h0125130@wu-wien.ac.at>
133    
134            * R/textdoccol.R (asPlain): Conversion from
135            StructuredTextDocuments to PlainTextDocuments.
136    
137    2007-07-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
138    
139            * R/termdocmatrix.R: Added convenience methods ("[", nrow, ncol)
140            for accessing term-document matrices.
141    
142            * inst/doc/tm.Rnw: readPDF is only called if pdftotext and pdfinfo
143            are installed.
144    
145    2007-07-17  Ingo Feinerer  <h0125130@wu-wien.ac.at>
146    
147            * R/termdocmatrix.R (TermDocMatrix): Improved efficiency. Kudos to
148            Christian Buchta.
149    
150    2007-07-15  Ingo Feinerer  <h0125130@wu-wien.ac.at>
151    
152            * inst/doc/tm.Rnw: Update vignette (readPDF, readHTML, preprocessReut21578XML).
153    
154    2007-07-14  Ingo Feinerer  <h0125130@wu-wien.ac.at>
155    
156            * R/reader.R (readHTML): Added very simple HTML reader to obtain StructuredTextDocuments.
157    
158            * R/reader.R (readPDF): Added PDF reader.
159    
160    2007-07-13  Ingo Feinerer  <h0125130@wu-wien.ac.at>
161    
162            * DESCRIPTION: Moved proxy from Depends to Imports to avoid name clashes.
163    
164            * inst/stopwords/english.dat: Added the term "yes" to stopwords.
165    
166            * R/termdocmatrix.R (dim): dim function for TermDocMatrix.
167    
168            * R/preprocess.R (convertMboxEml): Accepts gzipped mboxes.
169    
170    2007-07-11  Ingo Feinerer  <h0125130@wu-wien.ac.at>
171    
172            * R/distmeasure.R (dissimilarity): Replaced dists call from
173            package cba by new dist call from package proxy.
174    
175    2007-07-10  Ingo Feinerer  <h0125130@wu-wien.ac.at>
176    
177            * inst/doc/tm.Rnw: Described removeSparseTerms and Dictionary.
178    
179    2007-06-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
180    
181            * R/termdocmatrix.R: require() uses the quietly option to suppress
182            loading messages.
183    
184    2007-06-12  Ingo Feinerer  <h0125130@wu-wien.ac.at>
185    
186            * R/dictionary.R: Added dictionary support.
187    
188    2007-06-07  Ingo Feinerer  <h0125130@wu-wien.ac.at>
189    
190            * R/aobjects.R: Added classes for Reuters21578 XML and RCV1
191            documents. This simplifies some functions, e.g., asPlain.
192    
193    2007-06-06  Ingo Feinerer  <h0125130@wu-wien.ac.at>
194    
195            * inst/doc/tm.Rnw: Fixed some typos in vignette.
196    
197    2007-06-03  Ingo Feinerer  <h0125130@wu-wien.ac.at>
198    
199            * R/textdoccol.R (replaceWords): Added method to replace a set of
200            words by a single word. Useful for synonyms.
201    
202    2007-05-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
203    
204            * man/TermDocMatrix.Rd: Fixed documentation on Data slot.
205    
206    2007-05-19  Ingo Feinerer  <h0125130@wu-wien.ac.at>
207    
208            * R/termdocmatrix.R (textvector): Small fix for dealing with empty
209            vectors. Thanks to Ariel Maguyon for his error report.
210            (removeSparseTerms): New function to remove columns from a
211            term-document matrix exceeding a sparse factor.
212    
213    2007-05-15  Ingo Feinerer  <h0125130@wu-wien.ac.at>
214    
215            * man/tmUpdate.Rd: Corrected documentation on readerControl parameter.
216    
217    2007-05-11  Ingo Feinerer  <h0125130@wu-wien.ac.at>
218    
219            * man/sFilter.Rd: Corrected documentation on statement format (use
220            '==' instead of '=').
221    
222    2007-05-08  Ingo Feinerer  <h0125130@wu-wien.ac.at>
223    
224            * R/aobjects.R (StructuredTextDocument): Inherits from
225            TextDocument.
226    
227    2007-05-04  Ingo Feinerer  <h0125130@wu-wien.ac.at>
228    
229            * R/termdocmatrix.R (findFreqTerms): Perform efficient computation
230            on sparse matrices as proposed by Martin Maechler.
231    
232    2007-04-27  Ingo Feinerer  <h0125130@wu-wien.ac.at>
233    
234            * R/textdoccol.R: Removed \code{dbDisconnect} calls since last
235            \pkg{filehash} version makes them deprecated.
236    
237    2007-04-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
238    
239            * R/termdocmatrix.R (textvector): Stemming is now performed before
240            erasing stopwords.
241            (weightMatrix): Adapted to handle sparse matrices.
242            (TermDocMatrix): Sparse matrix is now efficiently built by
243            direct stepwise insertion of row values into it.
244    
245    2007-04-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
246    
247            * DESCRIPTION: Replaced \pkg{filehashSQLite} with \pkg{filehash}
248            due to ongoing problems. For our purposes the latter is as useful
249            as the replaced package.
250    
251    2007-04-20  Ingo Feinerer  <h0125130@wu-wien.ac.at>
252    
253            * man/TextDocCol.Rd: Replaced \code{readPlain} with \code{object@DefaultReader}.
254    
255            * man/TermDocMatrix.Rd: Remove deprecated \code{language} argument.
256    
257    2007-04-15  Ingo Feinerer  <h0125130@wu-wien.ac.at>
258    
259            * R/resolve.R (resolveISOCode): Added ISO 639-1 codes for
260            languages with available stopwords.
261    
262    2007-04-14  Ingo Feinerer  <h0125130@wu-wien.ac.at>
263    
264            * inst/doc/tm.Rnw: Minor corrections in the vignette.
265    
266    2007-04-11  Ingo Feinerer  <h0125130@wu-wien.ac.at>
267    
268            * DESCRIPTION: Update to version 0.2, since a lot of new features
269            have been integrated.
270    
271            * inst/stopwords: Updated existing stopwords and added stopwords
272            for various other languages.
273    
274    2007-04-10  Ingo Feinerer  <h0125130@wu-wien.ac.at>
275    
276            * man/: Updated documentation.
277    
278            * Work/testDb.R: Script to test database stuff.
279    
280            * R/: Fixed various database related bugs. Seems to be rather
281            useable now, i.e., consider as alpha status for now.
282    
283    2007-04-08  Ingo Feinerer  <h0125130@wu-wien.ac.at>
284    
285            * R/: Fixed some bugs related to database support.
286    
287    2007-04-07  Ingo Feinerer  <h0125130@wu-wien.ac.at>
288    
289            * man/: Added a lot of examples to the manuals.
290    
291    2007-04-05  Ingo Feinerer  <h0125130@wu-wien.ac.at>
292    
293            * man/: Updated parts of the documentation.
294    
295            * R/textdoccol.R (asPlain): Added conversion from newsgroup
296            documents to plain text documents.
297    
298    2007-04-01  Ingo Feinerer  <h0125130@wu-wien.ac.at>
299    
300            * R/textdoccol.R: Finished experimental database support. Not yet
301            intensively tested.
302    
303            * R/source.R: Now each source has a default reader.
304    
305            * R/reader.R: \code{FunctionGenerator} is now an attribute, not a
306            class anymore.
307    
308            * R/plaintextdoc.R: Custom show method for plain text documents.
309    
310            * R/aobjects.R: Added a class for structured text documents.
311    
312            * R/reader.R: Replaced remaining \code{parser} occurrences with
313            \code{reader}.
314    
315            * R/textdoccol.R (summary): Indent tags.
316    
317            * R/textdoccol.R (removePunctuation): Transform method to remove
318            punctuation marks.
319    
320    2007-03-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
321    
322            * R/textdoccol.R (sFilter): Simplified sFilter significantly by
323            using prescindMeta().
324    
325    2007-03-18  Ingo Feinerer  <h0125130@wu-wien.ac.at>
326    
327            * R/textdoccol.R: Improved database support.
328    
329    2007-03-16  Ingo Feinerer  <h0125130@wu-wien.ac.at>
330    
331            * R/termdocmatrix.R (TermDocMatrix): Uses sparse matrices.
332    
333            * R/resolve.R (resolveISOcode): Extracts the language from a ISO
334            language code.
335    
336            * R/textdoccol.R (TextDocCol): Refactored several parser arguments
337            into parserControl argument.
338    
339            * R/aobjects.R (TextDocument): Introduced the "Language" slot.
340    
341    2007-03-14  Ingo Feinerer  <h0125130@wu-wien.ac.at>
342    
343            * Work/tmDataSetup.R: The datasets acq and crude can now be
344            created on the fly.
345    
346            * R/stopwords.R: Introduced a function returning the stopwords for
347            a given language (English, German and French at the moment)
348    
349            * R/textdoccol.R (stemDoc): Stemming uses Rstem if available,
350            otherwise falls back to Snowball package.
351    
352    2007-01-30  Ingo Feinerer  <h0125130@wu-wien.ac.at>
353    
354            * man/dissimilarity-methods.Rd: Make clear that any method offered
355            by "dists" from package "cba" can be used.
356    
357    2007-01-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
358    
359            * inst/doc/tm.Rnw: Fixed quotes-appearing-as-boxes-bug according
360            to Kurt's latex suggestion. Removed points and underscores in
361            variable names for consistent naming.
362    
363            * DESCRIPTION: Update to version 0.1-2.
364    
365            * man/TextRepository.Rd: Fixed bug in documentation.
366    
367    2007-01-12  Ingo Feinerer  <h0125130@wu-wien.ac.at>
368    
369            * DESCRIPTION: Update to version 0.1-1.
370    
371    2007-01-09  Ingo Feinerer  <h0125130@wu-wien.ac.at>
372    
373            * R/textdoccol.R (stemDoc): Use Rstem::wordStem instead of
374            wordStem.
375    
376    2007-01-06  Ingo Feinerer  <h0125130@wu-wien.ac.at>
377    
378            * R/: Changes due to Kurt's review.
379    
380    2006-12-31  Ingo Feinerer  <h0125130@wu-wien.ac.at>
381    
382            * R/: Implemented improvements based upon comments by David
383            Meyer.
384    
385    2006-12-17  Ingo Feinerer  <h0125130@wu-wien.ac.at>
386    
387            * inst/doc/: Rewrote vignette.
388    
389            * man/: Improved documentation.
390    
391    2006-12-16  Ingo Feinerer  <h0125130@wu-wien.ac.at>
392    
393            * man/: Updated documentation.
394    
395            * DESCRIPTION: Changed package name to "tm". Updated version to
396            0.1 for first CRAN release.
397    
398            * inst/texts/gmane.comp.lang.r.general.mbox: mbox Gmane R mailing
399            list archive example.
400    
401            * inst/texts/gmane.comp.lang.r.gr.rdf: RSS Gmane R mailing list
402            archive example.
403    
404            * R/preprocess.R (convert_mbox_eml): A simple e-mail converter
405            from (several mails per box) mbox format to (single mail per file)
406            eml format.
407    
408    2006-12-08  Ingo Feinerer  <h0125130@wu-wien.ac.at>
409    
410            * data/crude.rda: Rebuilt.
411    
412            * data/acq.rda: Rebuilt.
413    
414            * R/reader.R: Factored out reader and parser methods from
415            textdoccol.R.
416    
417            * R/source.R: Factored out Source methods from aobjects.R and
418            textdoccol.R.
419            (GmaneRSource): Encapsulates Gmane R mailing list archive RSS
420            feeds.
421    
422            * R/textdoccol.R (DirSource): Added support for recursive
423            traversal of directories.
424    
425    2006-12-07  Ingo Feinerer  <h0125130@wu-wien.ac.at>
426    
427            * R/textdoccol.R ([[): Loads the document corpus automatically
428            into memory upon access.
429            (tm_transform, tm_filter): Removed several checks whether the
430            document is already loaded ([[ ensures this now).
431            (gmane_r_reader): Reader for RSS feeds as provided by the Gmane R
432            mailing list archive.
433    
434    2006-12-06  Ingo Feinerer  <h0125130@wu-wien.ac.at>
435    
436            * R/aobjects.R (TextDocument): Is now a virtual class.
437            (Source): Is now a virtual class.
438    
439    2006-12-05  Ingo Feinerer  <h0125130@wu-wien.ac.at>
440    
441            * R/textdoccol.R (c): Support for an arbitrary number of document
442            collections.
443    
444    2006-11-26  Ingo Feinerer  <h0125130@wu-wien.ac.at>
445    
446            * R/textrepo.R: Updated TextRepository (constructor), append_elem,
447            append_meta and remove_meta.
448    
449            * R/textdoccol.R: Removed modify_metadata method.
450    
451            * R/textrepo.R: Removed modify_metadata method.
452    
453            * R/textdoccol.R (remove_meta): Supports removal of document
454            collection metadata and document (= in data frame) metadata.
455    
456    2006-11-23  Ingo Feinerer  <h0125130@wu-wien.ac.at>
457    
458            * R/textdoccol.R (append_doc): Bug fix for handling empty metadata.
459    
460            * data/crude.rda: Rebuilt.
461    
462            * data/acq.rda: Rebuilt.
463    
464            * inst/doc/textmin.Rnw: Updated vignette to reflect code changes.
465    
466            * R/textdoccol.R ([): Bug fix for subsetting a document
467            collection's data frame.
468    
469    2006-11-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
470    
471            * R/textdoccol.R: Bug fixes in s_filter. Added full query support
472            to s_filter.
473    
474            * R/textdoccol.R: Local text documents' metadata can now be copied
475            to a document collection's data frame with prescind_meta.
476    
477    2006-11-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
478    
479            * R/: Text documents' slot metadata is now accessible in s_filter.
480    
481            * R/: Rewrote s_filter function (has still some restrictions).
482    
483    2006-11-20  Ingo Feinerer  <h0125130@wu-wien.ac.at>
484    
485            * R/: Various fixes in handling metadata.
486    
487            * R/: Added update mechanism for text document collections.
488    
489    2006-11-19  Ingo Feinerer  <h0125130@wu-wien.ac.at>
490    
491            * R/: Merging of document collections now creates a binary tree
492            for reconstructing merged document collections.
493    
494            * R/: Redesign of metadata for document collections.
495    
496    2006-11-07  Ingo Feinerer  <h0125130@wu-wien.ac.at>
497    
498            * R/: Messages now use \code{ngettext}.
499    
500    2006-11-03  Ingo Feinerer  <h0125130@wu-wien.ac.at>
501    
502            * R/: Added functions for modifying and removing metadata.
503    
504    2006-11-01  Ingo Feinerer  <h0125130@wu-wien.ac.at>
505    
506            * man/: Updated some documentation.
507    
508            * R/: Corrected some connection issues.
509    
510            * inst/doc: Worked on the vignette.
511    
512    2006-10-31  Ingo Feinerer  <h0125130@wu-wien.ac.at>
513    
514            * inst/: Added texts and started vignette.
515    
516            * R/: Final changes based upon David's comments.
517    
518    2006-10-29  Ingo Feinerer  <h0125130@wu-wien.ac.at>
519    
520            * NAMESPACE: Corrected exports (generic methods need exportMethods
521            directives!).
522    
523    2006-10-26  Ingo Feinerer  <h0125130@wu-wien.ac.at>
524    
525            * R/: Modified the TextDocCol constructur and various parsers. It
526            is now modular and supports various file formats via plugins (see
527            the new "Source" class).
528    
529    2006-10-24  Ingo Feinerer  <h0125130@wu-wien.ac.at>
530    
531            * man/: Revised documentation after previous code changes.
532    
533    2006-10-23  Ingo Feinerer  <h0125130@wu-wien.ac.at>
534    
535            * R/: Remaining changes as discussed with David.
536    
537    2006-10-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
538    
539            * R/: Some changes as suggested by David. The rest will follow
540            within the next days.
541    
542  2006-09-26  Ingo Feinerer  <h0125130@wu-wien.ac.at>  2006-09-26  Ingo Feinerer  <h0125130@wu-wien.ac.at>
543    
544          * man/: Finished documentation.          * man/: Finished documentation.

Legend:
Removed from v.59  
changed lines
  Added in v.831

root@r-forge.r-project.org
ViewVC Help
Powered by ViewVC 1.0.0  
Thanks to:
Vienna University of Economics and Business Powered By FusionForge