SCM

SCM Repository

[tm] Diff of /trunk/tm/ChangeLog
ViewVC logotype

Diff of /trunk/tm/ChangeLog

Parent Directory Parent Directory | Revision Log Revision Log | View Patch Patch

trunk/R/textmin/ChangeLog revision 65, Tue Oct 31 17:10:24 2006 UTC trunk/tm/ChangeLog revision 819, Thu Jan 31 09:09:18 2008 UTC
# Line 1  Line 1 
1    2008-01-31  Ingo Feinerer  <h0125130@wu-wien.ac.at>
2    
3            * R/textdoccol.R (writeCorpus): Function for writing a corpus
4            containing plain text documents to disk.
5    
6    2008-01-30  Ingo Feinerer  <h0125130@wu-wien.ac.at>
7    
8            * R/termdocmatrix.R (TermDocMatrix): Ensure that dimnames are
9            always set correctly.
10    
11            * R/textdoccol.R: Set load = TRUE as default for load on demand
12            since in most cases this is the wanted behaviour.
13    
14    2008-01-24  Ingo Feinerer  <h0125130@wu-wien.ac.at>
15    
16            * R/: Renamed TextDocCol to Corpus, and Corpus to Content.
17    
18            * DESCRIPTION: Updated Version to 0.3 due to core name changes.
19    
20    2008-01-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
21    
22            * R/meta.R (meta): New function for consistent access to meta data
23            of document collections, repositories, and texts.
24    
25    2008-01-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
26    
27            * R/: Better support for encodings.
28    
29    2008-01-13  Ingo Feinerer  <h0125130@wu-wien.ac.at>
30    
31            * R/textdoccol.R (TextDocCol): Fixed bug regarding default reader
32            selection when no reader argument is given.
33    
34    2008-01-05  Ingo Feinerer  <h0125130@wu-wien.ac.at>
35    
36            * R/source.R (CSVSource): Now uses read.csv instead of scan
37            internally.
38    
39    2008-01-02  Ingo Feinerer  <h0125130@wu-wien.ac.at>
40    
41            * R/reader.R (getReaders): Returns available reader functions.
42    
43            * R/termdocmatrix.R (TermDocMatrix): Set new modular constructor
44            as default.
45    
46    2007-12-02  Ingo Feinerer  <h0125130@wu-wien.ac.at>
47    
48            * R/stopwords.R (stopwords): Shortened code, removed codetools
49            variable warnings.
50    
51            * man/: Documentation for showMeta, added an example for tmMap.
52    
53            * inst/doc/tm.Rnw: Updated vignette, comments on MS word reader,
54            some minor typos fixed.
55    
56    2007-12-01  Ingo Feinerer  <h0125130@wu-wien.ac.at>
57    
58            * R/aobjects.R (showMeta): Added method for pretty printing a
59            text document's meta data.
60    
61    2007-11-29  Ingo Feinerer  <h0125130@wu-wien.ac.at>
62    
63            * R/textdoccol.R (TextDocCol): Better handling of empty
64            arguments.
65    
66            * NAMESPACE: Exported readDOC.
67    
68            * man/completeStems.Rd: Added an example.
69    
70    2007-11-18  Ingo Feinerer  <h0125130@wu-wien.ac.at>
71    
72            * R/stopwords.R (stopwords): Look up .dat files at every
73            call. Allows users to modify stopword .dat files interactively.
74    
75    2007-11-06  Ingo Feinerer  <h0125130@wu-wien.ac.at>
76    
77            * R/termdocmatrix.R (termFreq): Correct processing of empty
78            documents.
79    
80    2007-10-27  Ingo Feinerer  <h0125130@wu-wien.ac.at>
81    
82            * man/: Updated documentation.
83    
84    2007-10-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
85    
86            * R/complete.R (completeStems): Completes (heuristically) word
87            stems.
88    
89            * R/termdocmatrix.R (TermDocMatrix2): New modular
90            constructor.
91    
92            * NAMESPACE: Exported termFreq.
93    
94    2007-10-16  Ingo Feinerer  <h0125130@wu-wien.ac.at>
95    
96            * R/reader.R (readDOC): Added MS Word reader (using antiword).
97    
98    2007-10-14  Ingo Feinerer  <h0125130@wu-wien.ac.at>
99    
100            * R/weight.R: Weighting functions for TermDocMatrix.
101    
102    2007-10-13  Ingo Feinerer  <h0125130@wu-wien.ac.at>
103    
104            * R/termdocmatrix.R (dimnames, colnames, rownames): Wrapper
105            functions for accessing dimension, column, and row names.
106    
107            * R/plot.R (plot.TermDocMatrix): Plot correlations between terms.
108    
109    2007-09-11  Ingo Feinerer  <h0125130@wu-wien.ac.at>
110    
111            * man/removePunctuation.Rd: Added documentation. Function also exported to NAMESPACE.
112    
113    2007-08-28  Ingo Feinerer  <h0125130@wu-wien.ac.at>
114    
115            * R/fungen.R: Use S4 class for function generators instead of S3 attributes.
116    
117    2007-07-29  Ingo Feinerer  <h0125130@wu-wien.ac.at>
118    
119            * R/reader.R (readPDF): Removed manual checks for pdftotext and
120            pdfinfo. The system call gives a warning anyway.
121    
122    2007-07-28  Ingo Feinerer  <h0125130@wu-wien.ac.at>
123    
124            * R/textdoccol.R (asPlain): Conversion from
125            StructuredTextDocuments to PlainTextDocuments.
126    
127    2007-07-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
128    
129            * R/termdocmatrix.R: Added convenience methods ("[", nrow, ncol)
130            for accessing term-document matrices.
131    
132            * inst/doc/tm.Rnw: readPDF is only called if pdftotext and pdfinfo
133            are installed.
134    
135    2007-07-17  Ingo Feinerer  <h0125130@wu-wien.ac.at>
136    
137            * R/termdocmatrix.R (TermDocMatrix): Improved efficiency. Kudos to
138            Christian Buchta.
139    
140    2007-07-15  Ingo Feinerer  <h0125130@wu-wien.ac.at>
141    
142            * inst/doc/tm.Rnw: Update vignette (readPDF, readHTML, preprocessReut21578XML).
143    
144    2007-07-14  Ingo Feinerer  <h0125130@wu-wien.ac.at>
145    
146            * R/reader.R (readHTML): Added very simple HTML reader to obtain StructuredTextDocuments.
147    
148            * R/reader.R (readPDF): Added PDF reader.
149    
150    2007-07-13  Ingo Feinerer  <h0125130@wu-wien.ac.at>
151    
152            * DESCRIPTION: Moved proxy from Depends to Imports to avoid name clashes.
153    
154            * inst/stopwords/english.dat: Added the term "yes" to stopwords.
155    
156            * R/termdocmatrix.R (dim): dim function for TermDocMatrix.
157    
158            * R/preprocess.R (convertMboxEml): Accepts gzipped mboxes.
159    
160    2007-07-11  Ingo Feinerer  <h0125130@wu-wien.ac.at>
161    
162            * R/distmeasure.R (dissimilarity): Replaced dists call from
163            package cba by new dist call from package proxy.
164    
165    2007-07-10  Ingo Feinerer  <h0125130@wu-wien.ac.at>
166    
167            * inst/doc/tm.Rnw: Described removeSparseTerms and Dictionary.
168    
169    2007-06-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
170    
171            * R/termdocmatrix.R: require() uses the quietly option to suppress
172            loading messages.
173    
174    2007-06-12  Ingo Feinerer  <h0125130@wu-wien.ac.at>
175    
176            * R/dictionary.R: Added dictionary support.
177    
178    2007-06-07  Ingo Feinerer  <h0125130@wu-wien.ac.at>
179    
180            * R/aobjects.R: Added classes for Reuters21578 XML and RCV1
181            documents. This simplifies some functions, e.g., asPlain.
182    
183    2007-06-06  Ingo Feinerer  <h0125130@wu-wien.ac.at>
184    
185            * inst/doc/tm.Rnw: Fixed some typos in vignette.
186    
187    2007-06-03  Ingo Feinerer  <h0125130@wu-wien.ac.at>
188    
189            * R/textdoccol.R (replaceWords): Added method to replace a set of
190            words by a single word. Useful for synonyms.
191    
192    2007-05-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
193    
194            * man/TermDocMatrix.Rd: Fixed documentation on Data slot.
195    
196    2007-05-19  Ingo Feinerer  <h0125130@wu-wien.ac.at>
197    
198            * R/termdocmatrix.R (textvector): Small fix for dealing with empty
199            vectors. Thanks to Ariel Maguyon for his error report.
200            (removeSparseTerms): New function to remove columns from a
201            term-document matrix exceeding a sparse factor.
202    
203    2007-05-15  Ingo Feinerer  <h0125130@wu-wien.ac.at>
204    
205            * man/tmUpdate.Rd: Corrected documentation on readerControl parameter.
206    
207    2007-05-11  Ingo Feinerer  <h0125130@wu-wien.ac.at>
208    
209            * man/sFilter.Rd: Corrected documentation on statement format (use
210            '==' instead of '=').
211    
212    2007-05-08  Ingo Feinerer  <h0125130@wu-wien.ac.at>
213    
214            * R/aobjects.R (StructuredTextDocument): Inherits from
215            TextDocument.
216    
217    2007-05-04  Ingo Feinerer  <h0125130@wu-wien.ac.at>
218    
219            * R/termdocmatrix.R (findFreqTerms): Perform efficient computation
220            on sparse matrices as proposed by Martin Maechler.
221    
222    2007-04-27  Ingo Feinerer  <h0125130@wu-wien.ac.at>
223    
224            * R/textdoccol.R: Removed \code{dbDisconnect} calls since last
225            \pkg{filehash} version makes them deprecated.
226    
227    2007-04-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
228    
229            * R/termdocmatrix.R (textvector): Stemming is now performed before
230            erasing stopwords.
231            (weightMatrix): Adapted to handle sparse matrices.
232            (TermDocMatrix): Sparse matrix is now efficiently built by
233            direct stepwise insertion of row values into it.
234    
235    2007-04-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
236    
237            * DESCRIPTION: Replaced \pkg{filehashSQLite} with \pkg{filehash}
238            due to ongoing problems. For our purposes the latter is as useful
239            as the replaced package.
240    
241    2007-04-20  Ingo Feinerer  <h0125130@wu-wien.ac.at>
242    
243            * man/TextDocCol.Rd: Replaced \code{readPlain} with \code{object@DefaultReader}.
244    
245            * man/TermDocMatrix.Rd: Remove deprecated \code{language} argument.
246    
247    2007-04-15  Ingo Feinerer  <h0125130@wu-wien.ac.at>
248    
249            * R/resolve.R (resolveISOCode): Added ISO 639-1 codes for
250            languages with available stopwords.
251    
252    2007-04-14  Ingo Feinerer  <h0125130@wu-wien.ac.at>
253    
254            * inst/doc/tm.Rnw: Minor corrections in the vignette.
255    
256    2007-04-11  Ingo Feinerer  <h0125130@wu-wien.ac.at>
257    
258            * DESCRIPTION: Update to version 0.2, since a lot of new features
259            have been integrated.
260    
261            * inst/stopwords: Updated existing stopwords and added stopwords
262            for various other languages.
263    
264    2007-04-10  Ingo Feinerer  <h0125130@wu-wien.ac.at>
265    
266            * man/: Updated documentation.
267    
268            * Work/testDb.R: Script to test database stuff.
269    
270            * R/: Fixed various database related bugs. Seems to be rather
271            useable now, i.e., consider as alpha status for now.
272    
273    2007-04-08  Ingo Feinerer  <h0125130@wu-wien.ac.at>
274    
275            * R/: Fixed some bugs related to database support.
276    
277    2007-04-07  Ingo Feinerer  <h0125130@wu-wien.ac.at>
278    
279            * man/: Added a lot of examples to the manuals.
280    
281    2007-04-05  Ingo Feinerer  <h0125130@wu-wien.ac.at>
282    
283            * man/: Updated parts of the documentation.
284    
285            * R/textdoccol.R (asPlain): Added conversion from newsgroup
286            documents to plain text documents.
287    
288    2007-04-01  Ingo Feinerer  <h0125130@wu-wien.ac.at>
289    
290            * R/textdoccol.R: Finished experimental database support. Not yet
291            intensively tested.
292    
293            * R/source.R: Now each source has a default reader.
294    
295            * R/reader.R: \code{FunctionGenerator} is now an attribute, not a
296            class anymore.
297    
298            * R/plaintextdoc.R: Custom show method for plain text documents.
299    
300            * R/aobjects.R: Added a class for structured text documents.
301    
302            * R/reader.R: Replaced remaining \code{parser} occurrences with
303            \code{reader}.
304    
305            * R/textdoccol.R (summary): Indent tags.
306    
307            * R/textdoccol.R (removePunctuation): Transform method to remove
308            punctuation marks.
309    
310    2007-03-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
311    
312            * R/textdoccol.R (sFilter): Simplified sFilter significantly by
313            using prescindMeta().
314    
315    2007-03-18  Ingo Feinerer  <h0125130@wu-wien.ac.at>
316    
317            * R/textdoccol.R: Improved database support.
318    
319    2007-03-16  Ingo Feinerer  <h0125130@wu-wien.ac.at>
320    
321            * R/termdocmatrix.R (TermDocMatrix): Uses sparse matrices.
322    
323            * R/resolve.R (resolveISOcode): Extracts the language from a ISO
324            language code.
325    
326            * R/textdoccol.R (TextDocCol): Refactored several parser arguments
327            into parserControl argument.
328    
329            * R/aobjects.R (TextDocument): Introduced the "Language" slot.
330    
331    2007-03-14  Ingo Feinerer  <h0125130@wu-wien.ac.at>
332    
333            * Work/tmDataSetup.R: The datasets acq and crude can now be
334            created on the fly.
335    
336            * R/stopwords.R: Introduced a function returning the stopwords for
337            a given language (English, German and French at the moment)
338    
339            * R/textdoccol.R (stemDoc): Stemming uses Rstem if available,
340            otherwise falls back to Snowball package.
341    
342    2007-01-30  Ingo Feinerer  <h0125130@wu-wien.ac.at>
343    
344            * man/dissimilarity-methods.Rd: Make clear that any method offered
345            by "dists" from package "cba" can be used.
346    
347    2007-01-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
348    
349            * inst/doc/tm.Rnw: Fixed quotes-appearing-as-boxes-bug according
350            to Kurt's latex suggestion. Removed points and underscores in
351            variable names for consistent naming.
352    
353            * DESCRIPTION: Update to version 0.1-2.
354    
355            * man/TextRepository.Rd: Fixed bug in documentation.
356    
357    2007-01-12  Ingo Feinerer  <h0125130@wu-wien.ac.at>
358    
359            * DESCRIPTION: Update to version 0.1-1.
360    
361    2007-01-09  Ingo Feinerer  <h0125130@wu-wien.ac.at>
362    
363            * R/textdoccol.R (stemDoc): Use Rstem::wordStem instead of
364            wordStem.
365    
366    2007-01-06  Ingo Feinerer  <h0125130@wu-wien.ac.at>
367    
368            * R/: Changes due to Kurt's review.
369    
370    2006-12-31  Ingo Feinerer  <h0125130@wu-wien.ac.at>
371    
372            * R/: Implemented improvements based upon comments by David
373            Meyer.
374    
375    2006-12-17  Ingo Feinerer  <h0125130@wu-wien.ac.at>
376    
377            * inst/doc/: Rewrote vignette.
378    
379            * man/: Improved documentation.
380    
381    2006-12-16  Ingo Feinerer  <h0125130@wu-wien.ac.at>
382    
383            * man/: Updated documentation.
384    
385            * DESCRIPTION: Changed package name to "tm". Updated version to
386            0.1 for first CRAN release.
387    
388            * inst/texts/gmane.comp.lang.r.general.mbox: mbox Gmane R mailing
389            list archive example.
390    
391            * inst/texts/gmane.comp.lang.r.gr.rdf: RSS Gmane R mailing list
392            archive example.
393    
394            * R/preprocess.R (convert_mbox_eml): A simple e-mail converter
395            from (several mails per box) mbox format to (single mail per file)
396            eml format.
397    
398    2006-12-08  Ingo Feinerer  <h0125130@wu-wien.ac.at>
399    
400            * data/crude.rda: Rebuilt.
401    
402            * data/acq.rda: Rebuilt.
403    
404            * R/reader.R: Factored out reader and parser methods from
405            textdoccol.R.
406    
407            * R/source.R: Factored out Source methods from aobjects.R and
408            textdoccol.R.
409            (GmaneRSource): Encapsulates Gmane R mailing list archive RSS
410            feeds.
411    
412            * R/textdoccol.R (DirSource): Added support for recursive
413            traversal of directories.
414    
415    2006-12-07  Ingo Feinerer  <h0125130@wu-wien.ac.at>
416    
417            * R/textdoccol.R ([[): Loads the document corpus automatically
418            into memory upon access.
419            (tm_transform, tm_filter): Removed several checks whether the
420            document is already loaded ([[ ensures this now).
421            (gmane_r_reader): Reader for RSS feeds as provided by the Gmane R
422            mailing list archive.
423    
424    2006-12-06  Ingo Feinerer  <h0125130@wu-wien.ac.at>
425    
426            * R/aobjects.R (TextDocument): Is now a virtual class.
427            (Source): Is now a virtual class.
428    
429    2006-12-05  Ingo Feinerer  <h0125130@wu-wien.ac.at>
430    
431            * R/textdoccol.R (c): Support for an arbitrary number of document
432            collections.
433    
434    2006-11-26  Ingo Feinerer  <h0125130@wu-wien.ac.at>
435    
436            * R/textrepo.R: Updated TextRepository (constructor), append_elem,
437            append_meta and remove_meta.
438    
439            * R/textdoccol.R: Removed modify_metadata method.
440    
441            * R/textrepo.R: Removed modify_metadata method.
442    
443            * R/textdoccol.R (remove_meta): Supports removal of document
444            collection metadata and document (= in data frame) metadata.
445    
446    2006-11-23  Ingo Feinerer  <h0125130@wu-wien.ac.at>
447    
448            * R/textdoccol.R (append_doc): Bug fix for handling empty metadata.
449    
450            * data/crude.rda: Rebuilt.
451    
452            * data/acq.rda: Rebuilt.
453    
454            * inst/doc/textmin.Rnw: Updated vignette to reflect code changes.
455    
456            * R/textdoccol.R ([): Bug fix for subsetting a document
457            collection's data frame.
458    
459    2006-11-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
460    
461            * R/textdoccol.R: Bug fixes in s_filter. Added full query support
462            to s_filter.
463    
464            * R/textdoccol.R: Local text documents' metadata can now be copied
465            to a document collection's data frame with prescind_meta.
466    
467    2006-11-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
468    
469            * R/: Text documents' slot metadata is now accessible in s_filter.
470    
471            * R/: Rewrote s_filter function (has still some restrictions).
472    
473    2006-11-20  Ingo Feinerer  <h0125130@wu-wien.ac.at>
474    
475            * R/: Various fixes in handling metadata.
476    
477            * R/: Added update mechanism for text document collections.
478    
479    2006-11-19  Ingo Feinerer  <h0125130@wu-wien.ac.at>
480    
481            * R/: Merging of document collections now creates a binary tree
482            for reconstructing merged document collections.
483    
484            * R/: Redesign of metadata for document collections.
485    
486    2006-11-07  Ingo Feinerer  <h0125130@wu-wien.ac.at>
487    
488            * R/: Messages now use \code{ngettext}.
489    
490    2006-11-03  Ingo Feinerer  <h0125130@wu-wien.ac.at>
491    
492            * R/: Added functions for modifying and removing metadata.
493    
494    2006-11-01  Ingo Feinerer  <h0125130@wu-wien.ac.at>
495    
496            * man/: Updated some documentation.
497    
498            * R/: Corrected some connection issues.
499    
500            * inst/doc: Worked on the vignette.
501    
502  2006-10-31  Ingo Feinerer  <h0125130@wu-wien.ac.at>  2006-10-31  Ingo Feinerer  <h0125130@wu-wien.ac.at>
503    
504            * inst/: Added texts and started vignette.
505    
506          * R/: Final changes based upon David's comments.          * R/: Final changes based upon David's comments.
507    
508  2006-10-29  Ingo Feinerer  <h0125130@wu-wien.ac.at>  2006-10-29  Ingo Feinerer  <h0125130@wu-wien.ac.at>

Legend:
Removed from v.65  
changed lines
  Added in v.819

root@r-forge.r-project.org
ViewVC Help
Powered by ViewVC 1.0.0  
Thanks to:
Vienna University of Economics and Business Powered By FusionForge