Struct KiwiToken 

pub struct KiwiToken {
    pub form: String,
    pub tag: KiwiPosTag,
    pub start: usize,
    pub length: usize,
    pub score: f64,
}

Kiwi 호환 토큰 구조체

Kiwi 형태소 분석 결과와 호환되는 출력 형식

Example

use mecab_ko_core::kiwi_compat::{KiwiToken, KiwiPosTag};

let token = KiwiToken {
    form: "안녕".to_string(),
    tag: KiwiPosTag::NNG,
    start: 0,
    length: 6, // UTF-8 바이트 길이
    score: -10.5,
};

assert_eq!(token.form, "안녕");
assert_eq!(token.tag, KiwiPosTag::NNG);

Fields

form: String

형태소 표면형

tag: KiwiPosTag

품사 태그

start: usize

시작 위치 (바이트 오프셋)

length: usize

길이 (바이트)

score: f64

분석 점수 (로그 확률)

Implementations

impl KiwiToken

pub fn new( form: impl Into<String>, tag: KiwiPosTag, start: usize, length: usize, score: f64, ) -> Self

새 토큰 생성

Example

use mecab_ko_core::kiwi_compat::{KiwiToken, KiwiPosTag};

let token = KiwiToken::new("하다", KiwiPosTag::VV, 0, 6, -5.2);
assert_eq!(token.form, "하다");

pub const fn end(&self) -> usize

끝 위치 계산 (start + length)

pub const fn to_mecab_tag(&self) -> PosTag

MeCab-Ko 품사 태그로 변환

Trait Implementations

impl Clone for KiwiToken

fn clone(&self) -> KiwiToken

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for KiwiToken

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Display for KiwiToken

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for KiwiToken

fn eq(&self, other: &KiwiToken) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for KiwiToken